Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper addresses the challenge of hallucinations in large language models (LLMs) by introducing a novel task for detecting hallucination spans while aligning them with input evidence. The authors train an encoder-based model that predicts masked output tokens from the input representation, leveraging prediction confidence to identify hallucinated spans and establish meaningful alignments. Experimental results demonstrate that this approach not only effectively detects hallucinations but also enhances the interpretability of the model's outputs through human-validated alignments.
Hallucination detection can be transformed from a black box into a transparent process by aligning output spans with their input evidence.
Hallucinations remain a major obstacle to the reliable use of large language models (LLMs) in conditional text generation. Existing methods primarily assess the factuality of an entire generated text, providing limited insight into which output spans are hallucinated or how they relate to the input. We introduce the task of hallucination span detection with input-side evidence alignment, which jointly identifies hallucinated spans and aligns output tokens with the corresponding input evidence. Our approach is based on the observation that faithful output tokens are predictable from the input, whereas hallucinated tokens are not. We therefore train an encoder-based model to predict masked output tokens from the input representation, using prediction confidence for hallucination detection while naturally producing alignments to the input. Experiments show that the proposed method effectively detects hallucinated spans and identifies meaningful input-side evidence. Human evaluation confirms the quality of the predicted alignments.