Search papers, labs, and topics across Lattice.
This paper introduces Spatio-Temporal Token Veto (ST-Veto), a training-free method designed to enhance the reasoning capabilities of Diffusion Multimodal Large Language Models (dMLLMs) by vetoing temporally unstable tokens and filtering weakly grounded tokens. By employing second-order Taylor prediction of confidence dynamics and utilizing image-attention mass, ST-Veto significantly improves the accuracy of reasoning tasks without incurring additional training or generation costs. The results demonstrate that ST-Veto outperforms standard decoding policies and previous Vision Language Model methods, achieving accuracy improvements of up to 9% across various multimodal reasoning benchmarks.
Vetoing unstable tokens can boost dMLLM reasoning accuracy by up to 9% without any extra training costs.
Vision Language Models (VLMs) achieve strong reasoning with Chain-of-Thought (CoT) prompting but incur high sequential-generation cost, error accumulation, and limited self-correction. Diffusion Multimodal Large Language Models (dMLLMs) unmask tokens in an order-agnostic process, improving efficiency and enabling iterative refinement, yet their reasoning and how to enhance it remain underexplored. We propose a training-free method, Spatio-Temporal Token Veto (ST-Veto), which leverages the ability to observe all token positions at each diffusion step. Rather than relying only on current-step confidence, ST-Veto vetoes temporally unstable tokens via second-order Taylor prediction of confidence dynamics and filters weakly grounded tokens using image-attention mass, swapping them with safer candidates. Across multiple dMLLMs and multimodal reasoning benchmarks, ST-Veto consistently outperforms standard decoding policies and prior VLM reasoning methods, improving accuracy by up to 9% with no additional training or generation cost. Analyses show that ST-Veto steers generation toward higher-confidence, better-grounded paths.
