Track the frontier, from condensed matter to cosmology.
Search papers, labs, and topics across Lattice.
OmniConfess is a training-free method that mitigates omni-modal hallucinations in OmniLLMs by analyzing token-level evidential dependence. By fixing candidate responses and re-scoring them under controlled channel-wise evidence interventions, it generates a structured "confession" revealing which evidence supports each token. This confession is then used to preserve grounded content and correct hallucinations arising from irrelevant or contradictory evidence, demonstrating significant mitigation across diverse modalities and tasks.
OmniLLMs can now confess which specific evidence tokens rely on, enabling targeted hallucination correction without retraining.
Omni-modal large language models (OmniLLMs) unify text, images, audio, and video, yet hallucinate when generation relies on the wrong evidence. Existing inference-time methods can reduce hallucinations, but rarely reveal which evidence sustains a generated commitment. We introduce OmniConfess, a training-free method for mitigating omni-modal hallucinations. It fixes a candidate response and re-scores it at token resolution under controlled channel-wise evidence interventions, producing a structured token-by-channel confession that reveals the response's evidential dependence. OmniConfess uses this confession to preserve grounded content and correct commitments driven by irrelevant or contradictory evidence. To evaluate OmniConfess, we construct OmniHalluBench, a 3,540-example benchmark built from six datasets spanning text, image, audio, and video settings and both judgment and free-form generation. Experiments show that OmniConfess mitigates hallucinations across heterogeneous modality and task settings. Our code and benchmark are publicly available at https://github.com/RongHuiQiang/OmniConfess.