Track the frontier, from condensed matter to cosmology.
Search papers, labs, and topics across Lattice.
This paper introduces τ_0-VLA, a hierarchical robot foundation model designed to enhance long-horizon robot manipulation by integrating world-model-guided test-time computation for subtask generation. By allowing the high-level policy to utilize execution memory and search for optimal subtasks before committing, the model effectively allocates additional computation to complex decisions. The results demonstrate that this approach significantly improves next-subtask prediction accuracy and overall success rates in executing extended manipulation tasks, even under distribution shifts.
Allocating additional computation during decision-making boosts long-horizon robot manipulation success by significantly enhancing subtask prediction accuracy.
Long-horizon robot manipulation requires a robot to both execute individual skills reliably and sequence them coherently over extended tasks. Most hierarchical vision-language-action (VLA) models make each such decision with a single forward pass, leaving no mechanism to allocate additional computation to difficult or consequential choices. We introduce τ_0-VLA, a hierarchical robot foundation model that formulates high-level subtask generation as a compute-scalable inference problem through world-model-guided test-time computation. At each inference step, the high-level policy uses execution memory to generate a subtask and, when needed, searches over alternatives before committing to its output. A low-level policy then executes the generated subtask across multiple robot embodiments. The policy is trained on 40,115 hours of heterogeneous real-world data with multimodal co-training. Across in-domain and distribution-shifted settings, allocating additional test-time computation substantially improves next-subtask prediction accuracy, and these gains translate into higher closed-loop success on long-horizon robot manipulation tasks.
Tsinghua AI