Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a novel framework for diagnosing hallucinations in VLMs by modeling their generation process as a dynamic cognitive trajectory within a Cognitive State Space. The framework uses information-theoretic probes to measure perceptual instability, inferential conflict, and decisional ambiguity, mapping these to geometric abnormalities in the trajectory. The key finding is a "geometric-information duality," where geometric abnormality corresponds to high information-theoretic surprisal, enabling state-of-the-art hallucination detection across diverse VLM tasks with weak supervision and robustness to calibration data contamination.
VLMs' hallucinations aren't just errors, but traceable pathologies in their "cognitive trajectory," diagnosable via geometric anomalies in a learned state space.
Vision-Language Models (VLMs) frequently"hallucinate"- generate plausible yet factually incorrect statements - posing a critical barrier to their trustworthy deployment. In this work, we propose a new paradigm for diagnosing hallucinations, recasting them from static output errors into dynamic pathologies of a model's computational cognition. Our framework is grounded in a normative principle of computational rationality, allowing us to model a VLM's generation as a dynamic cognitive trajectory. We design a suite of information-theoretic probes that project this trajectory onto an interpretable, low-dimensional Cognitive State Space. Our central discovery is a governing principle we term the geometric-information duality: a cognitive trajectory's geometric abnormality within this space is fundamentally equivalent to its high information-theoretic surprisal. Hallucination detection is counts as a geometric anomaly detection problem. Evaluated across diverse settings - from rigorous binary QA (POPE) and comprehensive reasoning (MME) to unconstrained open-ended captioning (MS-COCO) - our framework achieves state-of-the-art performance. Crucially, it operates with high efficiency under weak supervision and remains highly robust even when calibration data is heavily contaminated. This approach enables a causal attribution of failures, mapping observable errors to distinct pathological states: perceptual instability (measured by Perceptual Entropy), logical-causal failure (measured by Inferential Conflict), and decisional ambiguity (measured by Decision Entropy). Ultimately, this opens a path toward building AI systems whose reasoning is transparent, auditable, and diagnosable by design.