Search papers, labs, and topics across Lattice.
This paper introduces MIRAGE, a novel defense mechanism for long-form Retrieval-Augmented Generation (RAG) that addresses the challenge of misinformation in retrieved passages. By constructing a cross-document claim graph using Natural Language Inference (NLI) and employing a Defended-Claims Gate, MIRAGE effectively filters out misleading information and ensures that the generated content is grounded in consistent, multi-source evidence. The results show that MIRAGE significantly improves factual accuracy across various long-form question-answering benchmarks, outperforming existing robust-RAG approaches even in the presence of severe pollution in the retrieval process.
MIRAGE restores factuality in long-form RAG systems, even when faced with heavily polluted retrieval data, outperforming prior methods.
Retrieval-Augmented Generation (RAG) improves factuality by grounding LLMs in external evidence, but real-world retrieval is often polluted: semantically relevant passages may contain subtle misinformation, misleading framings, or fabrications. We introduce MIRAGE, a training-free, model-agnostic defense for long-form RAG. MIRAGE builds an NLI-based cross-document claim graph and applies a Defended-Claims Gate to either condition generation on a consistent, multi-source supported subset or to block retrieval and answer parametrically. We also release a minimal-edit pollution protocol spanning four perturbation families (Unambiguous, Conflicting, Misleading, Fabricated) to construct matched clean, mixed, and fully polluted evaluation regimes. Across four long-form QA benchmarks and multiple commercial and open-weight LLMs, pollution severely degrades vanilla RAG, while MIRAGE consistently restores factuality under mixed and fully polluted evidence and outperforms prior robust-RAG methods. Our implementation and datasets are available at https://github.com/SaadElDine/MIRAGE.
