Search papers, labs, and topics across Lattice.
This paper introduces RankVR, a novel framework for Composed Image Retrieval (CIR) that addresses the challenges posed by Noisy Triplet Correspondence (NTC) in large-scale datasets. By integrating the Global Structure Consistency Perception (GSCP) module and the Adaptive Semantic Value Calibration (ASVC) module, RankVR effectively decouples clean samples from structural noise and dynamically quantifies the semantic value of triplets. Experimental results on FashionIQ and CIRR datasets reveal that RankVR outperforms existing methods, showcasing its robustness in handling noisy environments.
RankVR achieves a significant leap in Composed Image Retrieval by effectively managing noisy data, outperforming state-of-the-art methods in challenging scenarios.
Composed Image Retrieval (CIR) constitutes a pivotal paradigm requiring models to perform joint reasoning on reference images and modification texts. However, the prevalence of Noisy Triplet Correspondence (NTC) in large-scale datasets severely constrains model performance. Existing denoising methods either target binary mismatches or rely on scalar-based point-wise estimation, neglecting rich global structural correlations among sample populations and dynamic value variations during training, thereby yielding suboptimal results. This paper identifies two critical unresolved challenges: Global Structural Inconsistency of Semantic Correlations and Hard Sample Discrimination Uncertainty. To address these, we propose RankVR, a framework designed to construct a robust CIR model via global structure consistency and dynamic value perception. Specifically, we introduce the Global Structure Consistency Perception (GSCP) module, which utilizes the Effective Rank of the Correlation Matrix to decouple clean samples from structural noise. By measuring rank difference, GSCP identifies samples disrupting macroscopic semantic symmetry. Furthermore, we develop the Adaptive Semantic Value Calibration (ASVC) module to distinguish high-value hard clean samples. By integrating training potential and reliability, it dynamically quantifies the semantic value of each triplet, ensuring effective utilization of hard samples while suppressing noise characterized by logical conflicts. Extensive experiments on the FashionIQ and CIRR benchmark datasets demonstrate that RankVR significantly outperforms existing state-of-the-art methods, validating its superior robustness in noisy environments.
