Search papers, labs, and topics across Lattice.
The paper introduces GuarantRAG, a framework for improving knowledge integration in retrieval-augmented generation by explicitly decoupling reasoning from evidence integration. GuarantRAG first generates an "Inner-Answer" based on the LLM's parametric knowledge, then generates a "Refer-Answer" using a contrastive DPO objective that suppresses internal hallucinations in favor of retrieved documents. Finally, a joint decoding mechanism dynamically fuses the Inner-Answer and Refer-Answer at the token level to improve both coherence and factual precision.
RAG models struggle to use retrieved knowledge even when it's relevant, but GuarantRAG's two-stage generation and joint decoding boosts accuracy by 12% and slashes hallucinations by 16%.
Retrieval-Augmented Generation (RAG) significantly enhances Large Language Models (LLMs) by providing access to external knowledge. However, current research primarily focuses on retrieval quality, often overlooking the critical''integration bottleneck'': even when relevant documents are retrieved, LLMs frequently fail to utilize them effectively due to conflicts with their internal parametric knowledge. In this paper, we argue that implicitly resolving this conflict in a single generation pass is suboptimal. We introduce GuarantRAG, a framework that explicitly decouples reasoning from evidence integration. First, we generate an''Inner-Answer''based solely on parametric knowledge to capture the model's reasoning flow. Second, to guarantee faithful evidence extraction, we generate a''Refer-Answer''using a novel Contrastive DPO objective. This objective treats the parametric Inner-Answer as a negative constraint and the retrieved documents as positive ground truth, forcing the model to suppress internal hallucinations in favor of external evidence during this phase. Finally, rather than naive concatenation or using the DPO trained model directly, we propose a joint decoding mechanism that dynamically fuses the logical coherence of the Inner-Answer with the factual precision of the Refer-Answer at the token level. Experiments on five QA benchmarks demonstrate that GuarantRAG improves accuracy by up to 12.1% and reduces hallucinations by 16.3% compared to standard and dynamic RAG baselines.
