Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
To prevent multimodal models from bypassing hidden-state computation via residual visual pathways, the authors develop Causal Visual Recurrent Reasoning (CVRR), an architecture that completely purges the multimodal KV cache and raw visual tokens prior to decoding. This forces the model through a strict latent bottleneck, distinguishing true hidden-state computation from the mere passive presence of visual tokens. Evaluated on V*, MMVP, and BLINK, CVRR maintains strong visual reasoning performance under this zero-cache constraint where prior latent reasoners fail, with causal ablation confirming that predictions directly depend on the recurrent latent trajectory.
Multimodal models frequently bypass their supposed latent reasoning chains via lingering visual caches—severing these bypass paths proves that recurrence can genuinely carry the full inferential burden without sacrificing visual competence.
Latent visual reasoning aims to perform multimodal reasoning through hidden-state computation rather than explicit textual chains of thought. However, visual information being present in a latent state does not imply that the model actually relies on that state when producing its answer, especially when alternative image-conditioned paths remain available. We introduce Causal Visual Recurrent Reasoning (CVRR), which preserves pretrained visual competence while making recurrent computation the required image-conditioned path to prediction. CVRR initializes recurrence from the question hidden state after the pretrained vision-language model has incorporated the image, then repeatedly updates this state while re-reading the same fixed visual evidence. Before decoding, visual states and the original multimodal KV cache are removed so that only the final recurrent state carries image-conditioned information to the answer. Across the V^*, MMVP, BLINK, and MME-RealWorld-Lite benchmarks, CVRR retains strong performance under this strict interface, while compatible latent reasoners fail to recover comparable visual competence even when retrained under the same constraint. Causal interventions further show that predictions remain sensitive to recurrent content when the question is held fixed, and that persistent visual evidence causally revises the recurrent trajectory. These results distinguish latent informativeness from latent computation that is actually used for prediction.