Search papers, labs, and topics across Lattice.
NVIDIAAffiliation:Chung-AngKyungpook National UniversitySamsung Changwon HospitalSNUSoonchunhyang UniversitySep 8, 2026arXiv:2609.08182WSPolypNet localizes polyps in colonoscopy video under weak video-level supervision by extracting 3D CNN Class Activation Maps (CAMs) and feeding them as point prompts into MedSAM2 for temporal mask propagation. Eliminating frame-level spatial labels removes a massive data-labeling bottleneck that currently restricts the scaling of clinical video understanding systems. The framework achieves an overall recall of 94.51% and a CorLoc@0.5 of 43.68%, nearly doubling localization accuracy on challenging small polyps from 16.01% to 30.97% via a multi-view prompt refinement strategy.
Video-level labels alone can reliably drive clinical video segmentation: coarse 3D-CAM cues paired with MedSAM2 achieve 94.5% recall and double small-polyp localization without a single manual frame annotation.
Because dense frame-level annotation of colonoscopy videos is costly, we propose WSPolypNet, a weakly supervised framework for polyp localization using only video-level labels. WSPolypNet employs a 3D convolutional neural network trained with video-level supervision to generate class activation maps (CAMs), which identify candidate polyp regions without requiring frame-level spatial annotations. The CAM-derived localization cues are further enhanced using a multi-view strategy and provided to MedSAM2 as point prompts. MedSAM2 then propagates segmentation masks across the video, refining the coarse localization cues according to polyp boundaries. WSPolypNet achieved CorLoc scores of 47.80%, 43.68%, and 35.01% at IoU thresholds of 0.3, 0.5, and 0.7, respectively, compared with 36.87%, 33.72%, and 27.94% in the single-view setting. For small polyps, the multi-view strategy improved CorLoc@0.5 from 16.01% to 30.97%. The framework also achieved a recall of 94.51%. These results demonstrate the potential of weakly supervised spatiotemporal learning to substantially reduce spatial annotation requirements for polyp localization in colonoscopy videos.
