Search papers, labs, and topics across Lattice.
This paper tackles the Noisy Triplet Correspondence (NTC) problem in Composed Image Retrieval (CIR) by decoupling the learner and arbiter. They introduce Air-Know, an "Expert-Proxy-Diversion" paradigm that uses MLLMs as offline experts to create a high-precision anchor dataset, then distills this knowledge into a lightweight proxy "arbiter". The arbiter's matching confidence is then used to divert training data into clean alignment and representation feedback streams, mitigating representation pollution.
MLLMs can be distilled into lightweight arbiters that dramatically improve the robustness of composed image retrieval by disentangling noisy training signals.
Composed Image Retrieval (CIR) has attracted significant attention due to its flexible multimodal query method, yet its development is severely constrained by the Noisy Triplet Correspondence (NTC) problem. Most existing robust learning methods rely on the "small loss hypothesis", but the unique semantic ambiguity in NTC, such as "partial matching", invalidates this assumption, leading to unreliable noise identification. This entraps the model in a self dependent vicious cycle where the learner is intertwined with the arbiter, ultimately causing catastrophic "representation pollution". To address this critical challenge, we propose a novel "Expert-Proxy-Diversion" decoupling paradigm, named Air-Know (ArbIteR calibrated Knowledge iNternalizing rObust netWork). Air-Know incorporates three core modules: (1) External Prior Arbitration (EPA), which utilizes Multimodal Large Language Models (MLLMs) as an offline expert to construct a high precision anchor dataset; (2) Expert Knowledge Internalization (EKI), which efficiently guides a lightweight proxy "arbiter" to internalize the expert's discriminative logic; (3) Dual Stream Reconciliation (DSR), which leverages the EKI's matching confidence to divert the training data, achieving a clean alignment stream and a representation feedback reconciliation stream. Extensive experiments on multiple CIR benchmark datasets demonstrate that Air-Know significantly outperforms existing SOTA methods under the NTC setting, while also showing strong competitiveness in traditional CIR.
