Search papers, labs, and topics across Lattice.
The paper introduces CoCo-SAM3, a method for improving open-vocabulary semantic segmentation by addressing concept conflicts arising from independent mask generation using SAM with multiple category prompts. CoCo-SAM3 decouples inference into intra-class enhancement (aligning evidence from synonymous prompts) and inter-class competition (pixel-wise comparison on a unified scale). Experiments across eight benchmarks demonstrate that CoCo-SAM3 consistently improves open-vocabulary semantic segmentation without additional training by stabilizing multi-class inference and mitigating inter-class conflicts.
Resolving semantic conflicts between synonymous prompts and across categories dramatically improves the stability and accuracy of open-vocabulary semantic segmentation, all without requiring any additional training.
SAM3 advances open-vocabulary semantic segmentation by introducing a prompt-driven mask generation paradigm. However, in multi-class open-vocabulary scenarios, masks generated independently from different category prompts lack a unified and inter-class comparable evidence scale, often resulting in overlapping coverage and unstable competition. Moreover, synonymous expressions of the same concept tend to activate inconsistent semantic and spatial evidence, leading to intra-class drift that exacerbates inter-class conflicts and compromises overall inference stability. To address these issues, we propose CoCo-SAM3 (Concept-Conflict SAM3), which explicitly decouples inference into intra-class enhancement and inter-class competition. Our method first aligns and aggregates evidence from synonymous prompts to strengthen concept consistency. It then performs inter-class competition on a unified comparable scale, enabling direct pixel-wise comparisons among all candidate classes. This mechanism stabilizes multi-class inference and effectively mitigates inter-class conflicts. Without requiring any additional training, CoCo-SAM3 achieves consistent improvements across eight open-vocabulary semantic segmentation benchmarks.
