Search papers, labs, and topics across Lattice.
The paper introduces CoveR, a bi-encoder dense retrieval method designed to improve coverage in long-form retrieval-augmented generation (RAG). CoveR is trained using a novel coverage-based contrastive and distillation objective on the new SCOPE dataset, which contains 90K question-answer pairs with synthetic coverage signals derived from LLM-generated sub-question answerability judgments. Experiments demonstrate that CoveR improves nugget coverage by 10% compared to strong baselines while maintaining relevance.
Forget just finding relevant documents – CoveR boosts the *diversity* of retrieved information by 10%, a critical step for comprehensive long-form RAG.
Long-form Retrieval-Augmented Generation (RAG) brings the challenge of coverage-based ranking, because ranking methods must ensure the inclusion of comprehensive relevant nuggets (i.e., facts), which can thereby be synthesized into a comprehensive output. In this work, we propose CoveR (Our code is available at https://github.com/DylanJoo/CoveR ) a dense retrieval method optimized for coverage-aware retrieval scenarios. CoveR is a bi-encoder trained with the coverage-based contrastive and distillation objectives, which enables CoveR to capture diverse aspects of information needs. To train CoveR, we create the SCOPE dataset, (Our training data is available at https://huggingface.co/datasets/DylanJHJ/scope ) which comprises 90K training pairs from Researchy Questions with synthetic coverage signals augmented from sub-question answerability judgments generated by LLMs. Our empirical experiments show that CoveR enhances nugget coverage by 10\% over strong dense retrieval baselines without sacrificing its relevance-based retrieval capability. Further ablation studies validate the importance of our proposed learning method, showing that CoveR achieves a superior trade-off between relevance- and coverage-based ranking, which is essential for long-form RAG.
