Search papers, labs, and topics across Lattice.
This paper introduces VERDICT, a training-free verification method that leverages disagreement among multiple frozen verifiers to assess the validity of reasoning steps in multimodal large language models. By framing the problem as a coordination game, VERDICT identifies valid reasoning through consensus while utilizing disagreement to highlight potential errors. Evaluated across six benchmarks, VERDICT outperforms baseline models by up to 5.95% and shows competitive performance against heavily supervised domain-specific critics, underscoring the effectiveness of cross-modal disagreement in verification tasks.
Disagreement among verifiers can be a powerful signal for identifying errors in multimodal reasoning, leading to a 5.95% performance boost without any training.
Multimodal large language models often generate reasoning chains containing subtle errors that lead to incorrect answers. Current verification approaches have notable limitations. Existing approaches either require expensive labelled supervision with inconsistent cross-task performance or aggregate scores from multiple sources by simple aggregations, missing a key insight: when these scores disagree, that disagreement itself carries important information about whether a reasoning step is truly valid or not. We formalise this as a coupled scoring problem among disparate, frozen verifiers, interpretable as a coordination game with a unique closed-form equilibrium where agreement signals valid steps while disagreement reveals instability. Towards this end, we propose a training-free domain-agnostic step-wise verification approach we call VERDICT: VERification via Disagreement-Informed Coupled Thresholding. To our knowledge, VERDICT is the first training-free verifier that makes the structure of cross-modal disagreement explicit and actionable. It computes consensus scores through a closed-form solution, enabling both disagreement-aware filtering and stability-conscious ranking of reasoning steps. Evaluated across six benchmarks, \method consistently improves over the base model by up to +5.95%, and performs competitively with domain-specific critics that demand extensive supervision, demonstrating that cross-modal agreement provides robust verification signals without task-specific adaptation and Training-Free Verification