Search papers, labs, and topics across Lattice.
This paper introduces MPCoT, a novel reward-guided multi-path latent reasoning framework designed to enhance Vision-Language-Action (VLA) policies in long-horizon and high-uncertainty control scenarios. By initializing multiple hypotheses and refining them through a training-only path-preference objective, MPCoT effectively balances reasoning depth and inference efficiency without introducing additional token latency. The results demonstrate significant improvements in long-horizon performance on LIBERO and CALVIN benchmarks, confirming the effectiveness of the proposed method in maintaining action interface integrity while optimizing decision-making processes.
MPCoT achieves long-horizon VLA performance gains without increasing token latency, revolutionizing how we approach inference in complex control tasks.
Vision-Language-Action (VLA) policies remain brittle in long-horizon and high-uncertainty control, where one-pass action decoding provides limited inference-time deliberation. Explicit chain-of-thought can increase reasoning depth, but introduces token latency and an indirect text-to-action interface. We propose MPCoT, a reward-guided multi-path latent reasoning framework that initializes $M$ hypotheses, refines them for K weight-tied steps, and softly aggregates them before action decoding. A training-only path-preference objective evaluates candidate action branches with expert-action consistency, world-model/VLM-based progress, and success feedback to align the latent path scorer with downstream execution quality. MPCoT preserves the original 8-step action interface, generates zero reasoning tokens, and exposes configurable inference controls (K,M). Under matched protocols on LIBERO and CALVIN, MPCoT improves long-horizon performance, with ablations confirming depth-width effects, confidence-weighted aggregation, and reward-guided path supervision.
Tsinghua AI