Search papers, labs, and topics across Lattice.
This paper introduces a unified framework for diagnosing failure modes in vision-language models (VLMs) by disentangling errors related to perception, entity recognition, and knowledge retrieval. The authors demonstrate that pre-generation signals can effectively predict failure sources, revealing that recognition-related failures are best captured by visual-token representations, while persistent failures are better indicated by prompt-conditioned hidden states. This approach allows for targeted interventions in uncertain cases, enhancing the robustness of VLMs in challenging visual question answering tasks.
Pre-generation signals can predict failure sources in vision-language models, enabling targeted interventions before answers are generated.
Vision-language models (VLMs) perform well on visual question answering with high-quality images but struggle when questions require knowledge beyond what is clearly and directly visible. In such settings, uncertainty quantification should not only indicate whether the model is likely to fail but also diagnose why it is uncertain, across dimensions such as perception, entity recognition, and knowledge retrieval. While prior work has focused on individual failure modes in isolation or treated incorrect answers as monolithic failures, we propose a unified framework for disentangling these failure modes and investigate whether pre-generation signals can predict these failure sources. Across a range of datasets and model families, we find a consistent pattern in VLM errors: some failures arise from visual or recognition bottlenecks, while others persist after the relevant entity is identified. Our main finding is that these failure sources can be predicted before decoding: recognition-related failures are best captured by visual-token representations, while failures that remain after recognition are better captured by prompt-conditioned hidden states. This pre-generation signal enables efficient failure-source prediction before the model produces an answer, allowing uncertain cases to be routed to targeted interventions such as image repair, entity recognition support, or external retrieval.
