Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces Open-V, a training-free framework for Generalized Few-Shot Semantic Segmentation (GFSS) that leverages frozen semantic priors from foundation models instead of requiring parameter adaptation. By employing a combination of Segment Anything (SAM3) and Promptable Concept Segmentation (PCS) with K-shot CLIP support centroids, Open-V achieves significant performance improvements on benchmark datasets without any trainable components. The results demonstrate that inference-time semantic arbitration can effectively incorporate support information, leading to superior segmentation outcomes compared to traditional methods, with Open-V outperforming the strongest trained baseline by +17.7 HM on PASCAL-5i.
Training-free segmentation using frozen models can outperform conventional methods by a staggering 17.7 HM on benchmark datasets.
Generalized Few-Shot Semantic Segmentation (GFSS) has traditionally been approached as a representation-learning problem, requiring task-specific adaptation to incorporate novel classes from limited support examples. Recent foundation models, however, already exhibit strong open-vocabulary recognition and segmentation capabilities, raising a different question: can GFSS be solved through inference-time coordination of frozen semantic priors rather than parameter adaptation? We answer this question with Open-V, a training-free GFSS framework that combines Segment Anything (SAM3) Promptable Concept Segmentation (PCS) with a K-shot CLIP support centroid through calibrated per-pixel semantic arbitration. OpenV introduces no trainable components and supports arbitrary semantic categories at inference time. Beyond segmentation performance, our study contributes three broader findings. First, we show that support information can be incorporated through inference-time semantic grounding, and that its contribution increases as foundation-model text priors weaken on label-disjoint vocabularies. Second, we identify a reproducibility confound in foundationmodel segmentation, demonstrating that preprocessing and evaluation-space mismatches can silently distort reported performance. Finally, we validate Open-V across PASCAL5i, COCO-20i, and ADE-OW, showing that training-free coordination of foundation-model priors generalizes across both conventional GFSS and open-vocabulary evaluation settings. On PASCAL-5i (1-shot), Open-V attains base/novel/harmonic mIoU of 78.4/77.5/77.9, without GFSS-specific training surpassing the strongest trained baseline by +17.7 HM.