Search papers, labs, and topics across Lattice.
This paper introduces the Semantic-Spatial Discriminability Enhancement (SSDE) framework to improve Generalized Visual Grounding (GVG) by enhancing both semantic and spatial discriminability in complex multi-target scenarios. The approach addresses limitations of previous methods that struggle with visually similar targets by integrating a Semantic Discriminability Enhancement (SeDE) module for fine-grained semantic cues and a Spatial Discriminability Enhancement (SpDE) module for spatial localization. Experimental results demonstrate that SSDE significantly outperforms existing methods across ten datasets, establishing more reliable instance-level decision boundaries.
Fine-grained semantic and spatial enhancements in visual grounding lead to a remarkable boost in performance, tackling the confusion of visually similar targets head-on.
Generalized Visual Grounding (GVG) task aims to localize targets in an image based on referring expressions, extends the classical visual grounding paradigm by integrating multi-target and non-target scenarios. Previous methods typically rely on global semantic matching or coarse-grained region interactions for localization, where the discriminative cues are primarily derived from sentence-level semantics or regional context. In complex multi-target scenarios, such approaches tend to confuse visually similar targets, making it difficult to establish stable instance-level decision boundaries. To address these limitations, this paper proposes a novel Semantic-Spatial Discriminability Enhancement (SSDE) framework for generalized visual grounding, which aims to enhance the discriminative ability on fine-grained semantics and spatial localization, improving both cross-modal understanding and instance-level grounding. Specifically, to enhance the semantic discriminability of query representations at the fine-grained level, we propose a Semantic Discriminability Enhancement (SeDE) module, which leverages spatially guided cross-attention to disentangle fine-grained target-relevant visual attributes and integrates them with the textual subject semantics. Furthermore, to strengthen the spatial discriminability of the referred targets, we introduce a Spatial Discriminability Enhancement (SpDE) module, which models an instance center density map to characterize the spatial distribution of targets, and explicitly constructs instance separation structures in the spatial domain by employing them as an auxiliary supervision signal. Extensive experiments show that SSDE achieves superior performance on ten datasets across both classic and generalized visual grounding tasks.