Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper investigates the role of visual information in token-level uncertainty quantification (UQ) for Large Vision Language Models (LVLMs). They find that high-confidence predictions rely more on visual content compared to uncertain ones by analyzing hidden representations after visual feature integration. Based on this, they propose Visual-Grounded Token UQ (VIG-TUQ), a training-free framework that weights token-level language uncertainty with visual grounding scores, demonstrating improved UQ performance across diverse LVLM architectures.
Turns out, how much an LVLM "looks" at the image directly predicts how confident it is in its answer.
Uncertainty quantification (UQ) remains a critical challenge in Large Vision Language Models (LVLMs) for reliable predictions and real-world deployment. However, most existing methods are adapted from the LLM literature and primarily focus on the language modality, leaving the contribution of visual information to LVLM uncertainty largely underexplored. In this paper, we investigate how LVLMs process visual information and whether this process can be used to improve uncertainty estimation. By analyzing hidden representations after the integration of visual features during the generation process, we observe that high-confidence predictions rely more heavily on visual content than uncertain ones. Building on this insight, we propose Visual-Grounded Token UQ (VIG-TUQ), a training-free framework that explicitly incorporates visual grounding into uncertainty estimation by weighting token-level language uncertainty with visual grounding scores. We evaluate VIG-TUQ on multiple datasets and across diverse LVLM architectures, including early-fusion, late-fusion, and native-fusion models. Results indicate that our method often improves upon existing token-level uncertainty approaches. Code and data will be made available upon acceptance.