Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
The paper introduces OV-Stitcher, a training-free framework for open-vocabulary semantic segmentation that addresses the limitations of sliding-window approaches by stitching fragmented sub-image features directly within the final encoder block. This allows for global attention and contextual reasoning over the full image, leading to more coherent and spatially consistent segmentation maps. Experiments across eight benchmarks demonstrate that OV-Stitcher improves mean Intersection over Union (mIoU) from 48.7 to 50.7 compared to prior training-free baselines.
Stitching fragmented image features in the final encoder block unlocks global context in training-free semantic segmentation, boosting mIoU by 2 points without any additional training.
Training-free open-vocabulary semantic segmentation(TF-OVSS) has recently attracted attention for its ability to perform dense prediction by leveraging the pretrained knowledge of large vision and vision-language models, without requiring additional training. However, due to the limited input resolution of these pretrained encoders, existing TF-OVSS methods commonly adopt a sliding-window strategy that processes cropped sub-images independently. While effective for managing high-resolution inputs, this approach prevents global attention over the full image, leading to fragmented feature representations and limited contextual reasoning. We propose OV-Stitcher, a training-free framework that addresses this limitation by stitching fragmented sub-image features directly within the final encoder block. By reconstructing attention representations from fragmented sub-image features, OV-Stitcher enables global attention within the final encoder block, producing coherent context aggregation and spatially consistent, semantically aligned segmentation maps. Extensive evaluations across eight benchmarks demonstrate that OV-Stitcher establishes a scalable and effective solution for open-vocabulary segmentation, achieving a notable improvement in mean Intersection over Union(mIoU) from 48.7 to 50.7 compared with prior training-free baselines.