Search papers, labs, and topics across Lattice.
This paper introduces a Vision-Free framework for Composed Image Retrieval (CIR) that utilizes Attribute-Augmented Hybrid Scoring and LLM-Based Reranking to enhance retrieval accuracy despite the challenges posed by textual representations of images. The approach compensates for lost visual details through explicit attribute matching and ensures semantic consistency among top candidates using large language models. Experimental results demonstrate a significant performance improvement over existing zero-shot CIR methods, achieving a 44.04% R@1 score on the CIRR dataset, with additional insights on the balance between semantic reasoning and visual matching on FashionIQ.
Vision-Free approaches can outperform traditional methods in complex image retrieval tasks by leveraging attribute matching and LLM reranking, achieving a notable 44.04% R@1 score.
Recent work has shown that "Vision-Free'' approaches (representing images as text) can be effective for standard image retrieval tasks. However, it remains unclear whether this paradigm can effectively handle a more complex, multimodal task, Composed Image Retrieval (CIR), due to the inherent information loss in textual descriptions. In this paper, we introduce a Vision-Free CIR framework that addresses this challenge through two key techniques: (1) Attribute-Augmented Hybrid Scoring, which compensates for lost visual details via explicit attribute matching, and (2) LLM-Based Reranking, which verifies semantic consistency of top candidates. Experiments on the open-domain CIRR dataset show that our approach outperforms existing Zero-shot CIR methods (44.04% R@1, +8.79%). On FashionIQ, our results highlight the trade-off between semantic reasoning and fine-grained visual matching. Ablation studies reveal that both attribute-augmented scoring and LLM-Based Reranking consistently improve performance.
