Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
Addressing character-level visual hallucination detection, this work couples a compact 4B VLM fine-tuned on internal two-token hidden states with a zero-shot ~400B judge, backed by off-the-shelf OCR grounding. By leveraging synthetic errors generated by the larger model for training diversity, the framework tackles the high cost and low resolution of standard black-box multimodal hallucination evaluators. The resulting ensemble placed in the top 8 across all language tracks (EN, FR, IT, ZH) in the SHROOM-Visions 2026 shared task, achieving a mean test Cor-lbl of 0.387.
Probing internal two-token representations within a compact 4B VLM rivals massive model evaluation, providing high-resolution token-level hallucination detection when paired with a 400B judge.
We present our system for the SHROOM-Visions 2026 shared task on character-level VLM hallucination detection. A small ($4$B-parameter) VLM is fine-tuned as a per-token classifier reading a two-token feature from its own hidden states, and is ensembled with a $\sim$400B zero-shot VLM judge at prediction time. Both components see off-the-shelf OCR of any visible in-image text. We use synthetic hallucination data generated by the large model as a source of ensemble diversity, and use validation to select feature layer, training data and OCR grounding. Our official entry reaches mean Cor $0.487$ / Cor-lbl $0.387$ on the hidden test set, placing $6$th/$28$ (EN), $6$th/$21$ (FR), $8$th/$21$ (IT) and $7$th/$22$ (ZH) on the task's primary Cor-lbl metric.