Search papers, labs, and topics across Lattice.
ConRAG enhances multi-hop question answering in LLMs by optimizing both query and corpus sides of retrieval-augmented generation. It leverages multi-view evidence (relation, entity, and text) to improve retrieval accuracy. Experiments on multi-hop QA benchmarks demonstrate that ConRAG significantly outperforms existing methods, achieving up to 26.9% performance gains over vanilla RAG and setting a new state-of-the-art on the MuSiQue benchmark using Gemma-4-31B.
Multi-hop question answering gets a serious boost: ConRAG's consensus-driven, multi-view retrieval approach leapfrogs existing RAG methods by a significant margin.
Retrieval-augmented generation (RAG) has emerged as a promising paradigm for enhancing large language models (LLMs) on multi-hop question answering (QA), which requires reasoning over evidence from multiple documents. Current multi-hop RAG methods generally focus on either query-side task decomposition or corpus-side knowledge graph construction. Despite their progress, these methods still struggle to achieve satisfactory performance on complex multi-hop QA tasks. To this end, we propose ConRAG, a consensus-driven multi-view RAG framework that effectively boosts LLMs on complex multi-hop QA. The core of ConRAG is to systematically optimize both the query and corpus sides and to leverage multi-view evidence (relation, entity, and text signals) for more accurate retrieval. Extensive experiments on three multi-hop QA benchmarks show that ConRAG consistently outperforms all baselines by a clear margin, e.g., up to +26.9% average performance gains over vanilla RAG, and enables Gemma-4-31B to achieve a new state-of-the-art record on the challenging MuSiQue benchmark.
