Search papers, labs, and topics across Lattice.
This paper introduces DiffuSAM, a zero-shot object grounding pipeline for remote sensing imagery that leverages diffusion models for localization cues. DiffuSAM combines these cues with segmentation models like RemoteSAM and SAM3 to refine bounding box predictions. The approach achieves a 14% improvement in Acc@0.5 compared to existing state-of-the-art methods, demonstrating the effectiveness of integrating diffusion-based localization with segmentation.
Diffusion models can significantly boost zero-shot object grounding in remote sensing, outperforming existing methods by a large margin.
Diffusion models have emerged as powerful tools for a wide range of vision tasks, including text-guided image generation and editing. In this work, we explore their potential for object grounding in remote sensing imagery. We propose a hybrid pipeline that integrates diffusion-based localization cues with state-of-the-art segmentation models such as RemoteSAM and SAM3 to obtain more accurate bounding boxes. By leveraging the complementary strengths of generative diffusion models and foundational segmentation models, our approach enables robust and adaptive object localization across complex scenes. Experiments demonstrate that our pipeline significantly improves localization performance, achieving over a 14% increase in Acc@0.5 compared to existing state-of-the-art methods.
