Search papers, labs, and topics across Lattice.
The paper introduces ADAPT, an end-to-end framework for interactive humanoid control that integrates text conditioning directly into the control loop, allowing for real-time responsiveness to changing commands. By leveraging a diffusion-based action prior learned from text-labeled state-action trajectories, ADAPT enables the execution of diverse motion skills while maintaining balance and smooth transitions. The framework's effectiveness is validated through experiments showcasing robust skill execution and adaptable control, highlighting its potential for practical applications in humanoid robotics.
ADAPT enables humanoid robots to seamlessly execute diverse motion skills in real-time based on text commands, revolutionizing interactive control.
We present ADAPT, an end-to-end framework for interactive, text-conditioned humanoid whole-body control. Unlike dominant text-to-motion pipelines that generate kinematic motions for a separate tracker, ADAPT solves language control with an end-to-end closed-loop control framework, where the robot must continuously respond to changing commands while maintaining balance, natural motion, and smooth transitions. ADAPT learns a diffusion-based action prior from text-labeled humanoid state-action trajectories, enabling diverse motion skills to be directly executed from language commands. To improve long-horizon robustness and smooth prompt switching, we train a lightweight residual reinforcement learning policy on top of the frozen diffusion controller. We further show that the same diffusion policy can be reused as a steerable text-conditioned motion prior for downstream task adaptation. Experiments demonstrate robust language-grounded skill execution, smooth interactive transitions, and style-preserving downstream control.
