Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a Vision-Free framework for Composed Image Retrieval (CIR) that utilizes Attribute-Augmented Hybrid Scoring and LLM-Based Reranking to mitigate information loss from textual image representations. The methods enhance retrieval accuracy by explicitly matching attributes and ensuring semantic consistency among top candidates. Experimental results demonstrate a significant performance boost over existing zero-shot CIR methods, achieving a 44.04% R@1 score, underscoring the effectiveness of the proposed techniques in complex multimodal tasks.
Attribute-augmented scoring and LLM-based reranking together achieve an 8.79% improvement in zero-shot composed image retrieval, challenging the limitations of vision-free approaches.
Recent work has shown that"Vision-Free''approaches (representing images as text) can be effective for standard image retrieval tasks. However, it remains unclear whether this paradigm can effectively handle a more complex, multimodal task, Composed Image Retrieval (CIR), due to the inherent information loss in textual descriptions. In this paper, we introduce a Vision-Free CIR framework that addresses this challenge through two key techniques: (1) Attribute-Augmented Hybrid Scoring, which compensates for lost visual details via explicit attribute matching, and (2) LLM-Based Reranking, which verifies semantic consistency of top candidates. Experiments on the open-domain CIRR dataset show that our approach outperforms existing Zero-shot CIR methods (44.04% R@1, +8.79%). On FashionIQ, our results highlight the trade-off between semantic reasoning and fine-grained visual matching. Ablation studies reveal that both attribute-augmented scoring and LLM-Based Reranking consistently improve performance.