Search papers, labs, and topics across Lattice.
This paper introduces ThinkingVLA, a generative model that integrates Vision-Language-Action (VLA) reasoning by employing a unified Mixture-of-Transformers architecture. It enhances manipulation planning through a dual Chain-of-Thought (CoT) approach, where the model first predicts the next visual state and then employs inverse reasoning to determine the necessary actions. Extensive evaluations show that ThinkingVLA significantly outperforms existing models, particularly excelling in long-horizon manipulation tasks, highlighting its effectiveness in complex reasoning scenarios.
ThinkingVLA achieves a breakthrough in robotic manipulation by seamlessly interleaving visual and textual reasoning, leading to superior performance in long-horizon tasks.
Most Vision-Language-Action (VLA) models map observations directly to actions without explicit reasoning, limiting their capacity for reasoning-intensive long-horizon tasks. To address this, existing approaches adopt Chain-of-Thought (CoT) reasoning to enable subgoal decomposition and spatial anticipation. However, those methods lack a unified architecture for effective cross-modal reasoning and fail to explicitly include inverse reasoning ability based on the target state. We argue that manipulation planning naturally decomposes into prediction, anticipating the next visual state, and inverse dynamics, inferring the actions to reach it. Bridging both requires a unified autoregressive architecture that interleaves textual and visual reasoning in a single generation process. We propose \textbf{ThinkingVLA}, a generative model that realizes this decomposition within a unified Mixture-of-Transformers architecture. ThinkingVLA consists of a forward CoT that identifies the immediate subgoal and guides the visual forecasting; the predicted image then serves as the target state, grounding an inverse CoT that reasons about spatial relationships and action intent based on the predicted image; and the final action is generated conditioned on this full reasoning context. Extensive experiments on simulation and real-world benchmarks demonstrate that ThinkingVLA consistently outperforms state-of-the-art baselines, with particularly large gains on long-horizon manipulation tasks.
