Search papers, labs, and topics across Lattice.
This paper introduces AURORA, a novel framework for detecting hallucinations in large language models by analyzing the weight-gradient dynamics rather than relying on static representations. The method identifies distinct gradient update patterns associated with hallucinated versus faithful outputs, utilizing features such as cosine similarity skewness and rotation ratios derived from singular value decomposition. AURORA demonstrates robust performance across multiple model families and datasets, effectively transferring to out-of-domain tasks, which highlights its versatility and potential for real-world applications.
Hallucinated outputs trigger unique gradient patterns in LLMs, enabling AURORA to achieve superior detection performance across diverse tasks and models.
Large Language Models (LLMs) have demonstrated remarkable capabilities across a wide range of natural language processing tasks. However, their tendency to generate hallucinations, namely factually incorrect or unfaithful outputs, poses a critical obstacle to their deployment in high-stakes applications. Although recent hallucination detection methods have made encouraging progress, they typically rely on costly output-level consistency checks or static hidden-state probes that capture shallow dataset-specific patterns, leading to substantial degradation under cross-dataset evaluation. In this work, we propose AURORA, a novel hallucination detection framework that shifts the focus from static representations to the weight-gradient dynamics of LLMs. Our key insight is that hallucinated and faithful answers induce qualitatively different gradient update patterns on the model's parameters. Specifically, hallucinated samples trigger asymmetric and structurally misaligned gradients, which can be captured through two complementary features: (1) the skewness of the cosine similarity distribution between weight matrices and their gradient update directions, and (2) the rotation ratio, which quantifies how much the gradient update reorients the singular-vector basis of weight matrices via SVD. AURORA achieves strong hallucination detection performance across four model families and four benchmark datasets. Further analyses demonstrate that our method scales effectively across model sizes and transfers to out-of-domain tasks, including mathematical reasoning and vision-language scenarios.
