Search papers, labs, and topics across Lattice.
This paper introduces Intent-Guided Decoding (IGD), a novel framework that enhances retrieval-augmented generation (RAG) by dynamically balancing retrieved context and parametric memory based on user intent. By employing answer-level filtering and token-level correction, IGD effectively mitigates the risks of misleading or irrelevant context while maintaining or improving context-following behavior. Evaluations across multiple QA benchmarks demonstrate that IGD achieves significant improvements in factual recovery, with gains of up to 65.4 percentage points on factual-conflict benchmarks compared to traditional RAG methods.
IGD can boost factual accuracy in language models by over 65% while ensuring they still follow user context effectively.
Retrieval-augmented generation (RAG) improves large language models by grounding generation in external evidence, but it also introduces a source trust problem: retrieved context may be useful, irrelevant, or even misleading. Existing RAG systems often apply a fixed trust policy toward retrieved evidence, which can either over-trust incorrect context or underuse context when the user explicitly asks for context-following behavior. Therefore, we propose Intent-Guided Decoding (IGD), a framework that arbitrates between retrieved context and parametric memory according to user intent. IGD uses answer-level filtering and token-level correction to steer the final decoding trajectory between retrieved context and parametric memory. We evaluate IGD on three faithful QA benchmarks and three factual-conflict benchmarks across five LLMs, IGD substantially improves factual recovery, achieving gains of up to 65.4 percentage points on factual-conflict benchmarks over Direct RAG, while preserving or improving strict context-following behavior, this findings highlight the importance of balancing factuality and faithfulness in RAG.
