Search papers, labs, and topics across Lattice.
This paper introduces Dual-Confidence Contrastive Decoding (DCCD), a novel decoding method that addresses intra-context conflicts in retrieval-augmented generation (RAG) by leveraging both document-level and token-level confidence signals. The authors evaluate their approach using the DRQA benchmark, which simulates enterprise scenarios with conflicting evidence, demonstrating that DCCD outperforms existing decoding methods across multiple benchmarks, particularly excelling in scenarios with conflicting information. The findings underscore the necessity of incorporating source-aware confidence mechanisms to enhance the reliability of answers derived from multiple documents in RAG systems.
Intra-context conflicts in retrieval-augmented generation can be effectively resolved by a dual-confidence approach, leading to significant performance improvements in answering complex queries.
Retrieval-augmented generation (RAG) increasingly requires models to answer questions from multiple retrieved documents, where only some sources are relevant and the retrieved bundle may contain stale, noisy, or conflicting evidence. Existing contrastive decoding methods primarily focus on resolving conflicts between the model's internal memory and the retrieved context. In contrast, we study the complementary problem of intra-context conflict in multi-document RAG. To evaluate this setting, we introduce DRQA, a factual-conflict question answering benchmark derived from enterprise deep-research scenarios, where answers are grounded in synthetic enterprise-specific facts that are designed not to be recoverable from the model's internal memory. We further propose Dual-Confidence Contrastive Decoding (DCCD), a training-free decoding method that combines document-level confidence, which estimates whether a document appears sufficient for answering the question, with token-level confidence, which estimates whether that document supports a confident next-token prediction. DCCD selects positive and negative document-conditioned streams using these dual-confidence signals and scales a document-level contrast by their confidence margin. Across DRQA and standard multi-document QA benchmarks, DCCD achieves the best average performance among full-context and contrastive decoding baselines, with the largest gains on DRQA. These results highlight the importance of source-aware, confidence-gated decoding when retrieved evidence is internally conflicting.
