Search papers, labs, and topics across Lattice.
The paper introduces Recall Conversion Rate (RCR) to measure the contribution of retrieval to reasoning accuracy in RAG systems, revealing a decay in RCR as Recall@5 improves in mainstream methods. To address this, they propose NeocorRAG, a framework that optimizes retrieval quality by mining and utilizing Evidence Chains through an activated search algorithm and constrained decoding. Experiments on HotpotQA, 2WikiMultiHopQA, MuSiQue, and NQ demonstrate that NeocorRAG achieves state-of-the-art performance with significantly reduced token consumption compared to existing methods.
Retrieval improvements in RAG don't always boost reasoning, but NeocorRAG's evidence chains can fix that, achieving SOTA with 80% fewer tokens.
Although precise recall is a core objective in Retrieval-Augmented Generation (RAG), a critical oversight persists in the field: improvements in retrieval performance do not consistently translate to commensurate gains in downstream reasoning. To diagnose this gap, we propose the Recall Conversion Rate (RCR), a novel evaluation metric to quantify the contribution of retrieval to reasoning accuracy. Our quantitative analysis of mainstream RAG methods reveals that as Recall@5 improves, the RCR exhibits a near-linear decay. We identify the neglect of retrieval quality in these methods as the underlying cause. In contrast, approaches that focus solely on quality optimization often suffer from inferior recall performance. Both categories lack a comprehensive understanding of retrieval quality optimization, resulting in a trade-off dilemma. To address these challenges, we propose comprehensive retrieval quality optimization criteria and introduce the NeocorRAG framework. This framework achieves holistic retrieval quality optimization by systematically mining and utilizing Evidence Chains. Specifically, NeocorRAG first employs an innovative activated search algorithm to obtain a refined candidate space. Then it ensures precise evidence chain generation through constrained decoding. Finally, the retrieved set of evidence chains guides the retrieval optimization process. Evaluated on benchmarks including HotpotQA, 2WikiMultiHopQA, MuSiQue, and NQ, NeocorRAG achieves SOTA performance on both 3B and 70B parameter models, while consuming less than 20% of tokens used by comparable methods. This study presents an efficient, training-free paradigm for RAG enhancement that effectively optimizes retrieval quality while maintaining high recall. Our code is released at https://github.com/BUPT-Reasoning-Lab/NeocorRAG.
