Search papers, labs, and topics across Lattice.
This paper introduces CORTEX, a novel method for detecting token-level hallucinations in Retrieval-Augmented Generation (RAG) outputs by comparing internal representations of a large language model (LLM) under different conditions. By focusing on the influence of retrieved documents on token grounding, CORTEX effectively localizes hallucinations and reduces false positives through a propagation mechanism and a post-processing smoothing step. Experimental results demonstrate that CORTEX significantly enhances detection accuracy across multiple benchmarks and models, highlighting the importance of fine-grained analysis in mitigating hallucinations.
CORTEX reveals that token-level hallucinations can be detected with remarkable precision by leveraging the grounding effects of retrieved documents, leading to substantial improvements in RAG output reliability.
In this paper, we propose CORTEX, a token-level hallucination detection method for Retrieval-Augmented Generation (RAG). In long-form RAG outputs, hallucinations often arise in localized spans rather than throughout an entire response. CORTEX therefore identifies ungrounded content at the token level, enabling fine-grained localization of hallucinations. The key intuition behind CORTEX is that tokens grounded in retrieved documents should be more strongly influenced by those documents than hallucinated tokens. To capture this document-induced effect, CORTEX compares internal representations of a large language model (LLM) under two conditions: with and without the retrieved documents. Instead of relying solely on each token's immediate sensitivity to the retrieved documents, CORTEX also leverages the propagation of document-grounded information through preceding tokens, reducing false positives for tokens whose evidence has already been absorbed into the context. Finally, CORTEX applies post-processing smoothing step that models the tendency of hallucination labels to persist over contiguous spans, reducing local noise and encouraging span-consistent predictions. Experiments on two RAG benchmarks and three LLMs show that CORTEX substantially improves token-level hallucination detection, with each component consistently contributing to performance gains.
