Search papers, labs, and topics across Lattice.
This paper introduces E-TTS, a novel Embodied Test-Time Scaling framework that integrates reasoning and action scaling for robotic manipulation tasks by employing history-aware iterative refinement with vision-language verifiers. The framework addresses two critical challenges: the effective scaling of reasoning mechanisms and the utilization of historical context in long-horizon tasks. Experimental results across multiple benchmarks and environments show that E-TTS enhances performance significantly, achieving improvements of up to 33.14% in simulations and 26.62% in real-world applications without the need for additional expert data or retraining.
E-TTS achieves up to a 33.14% performance boost in robotic manipulation by leveraging historical context and iterative refinement, redefining how we approach test-time scaling.
Recently, a few works have made early attempts to study test-time scaling for embodied tasks. However, two major challenges remain unsolved: (1) reasoning can effectively improve the performance of the policy, but its scaling mechanism has seldom been studied; (2) historical information is essential, as embodied tasks are inherently long-horizon and sequential, making sole reliance on current observations for action scaling inadequate due to the lack of historical context utilization. To address these challenges, we introduce E-TTS, a modular and plug-and-play Embodied Test-Time Scaling framework that unifies reasoning and action scaling for robotic manipulation via history-aware iterative refinement with vision-language verifiers. To support joint reasoning-action scaling, E-TTS performs reasoning-action joint sampling and scoring in a pairwise manner. To better utilize historical information, E-TTS uses a history buffer to store historical context, which is then used by reasoning and action verifiers to evaluate the sampled candidates. Unlike conventional open-loop TTS methods, E-TTS introduces feedback generation into the sampling process to form a closed-loop iterative refinement mechanism, enhancing both inference efficiency and environmental adaptability. Each component functions as an independent and composable module, allowing flexible and adaptive configuration depending on task requirements. To evaluate the advantages of our framework, we conduct experiments across 4 different benchmarks, 6 environments, 3 embodiments, and 4 base vision-language-action models. The experimental results demonstrate that, without requiring additional expert data collection or retraining, E-TTS consistently improves performance, achieving up to a 33.14% increase in simulation and 26.62% in real-world scenarios.
