Track the frontier, from condensed matter to cosmology.
Search papers, labs, and topics across Lattice.
The authors formulate Token-Disentangled Latent Test-Time Scaling (TD-LTTS), an inference-time optimization framework that routes multimodal feedback to specific token representations based on their functional roles. This resolves a core failure mode of standard latent test-time scaling, which applies uniform scalar rewards across all editable latents despite vision tokens and abstract reasoning tokens demanding distinct learning signals. Evaluated on Qwen2.5-VL-7B and InternVL3.5-8B, TD-LTTS improves macro accuracy over standard chain-of-thought by +2.57 and +1.51 points respectively while outperforming output-space candidate search under matched generation budgets.
Treating all latent tokens identically bottlenecks multimodal test-time compute—disentangling hidden-state updates into visual-grounding and high-entropy reasoning channels beats standard output-space search under matched sample budgets.
Latent test-time scaling improves reasoning by refining hidden states during inference, but existing methods typically apply a single scalar reward to all editable latent tokens. For multimodal large language models, this global update ignores that generated tokens play different roles: some are sensitive to visual evidence, while others correspond to uncertain reasoning decisions. We present Token-Disentangled Latent Test-Time Scaling, an inference-time framework that makes latent refinement token-role-aware. Starting from an initial generated trajectory, we optimize a short hidden-state prefix while routing perception-side visual feedback to image-sensitive tokens and reasoning feedback to high-entropy tokens. Tokens selected by neither route are constrained by an anchor regularizer. Across both perception and reasoning benchmarks on Qwen2.5-VL-7B and InternVL3.5-8B, our method lifts macro accuracy over CoT by +2.57 and +1.51 respectively, and outperforms strong output-space test-time scaling baselines under matched decoded-candidate budgets. Code is available at https://github.com/Qwen-Applications/TD-LTTS.
DAMO