Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a three-stage pipeline that transforms motion-imitation skills into a reusable hybrid motion prior (HMP) for humanoid locomotion. By training an expert policy to imitate human motion, distilling it into a structured architecture, and then using this HMP to train task-specific policies, the authors demonstrate that the HMP can effectively serve as a versatile action interface across various locomotion tasks. The method was validated through simulations and real-world deployment, revealing that the learned HMP maintains expert tracking behavior while providing an interpretable codebook for gait modulation.
The hybrid motion prior enables seamless transfer of locomotion skills across tasks, eliminating the need for retraining while preserving expert performance.
Reinforcement learning can produce robust humanoid controllers, but each new task is typically trained as a separate policy with its own reward design and training process. Motion imitation provides an alternative source of motor competence by training policies to track retargeted human motions, yet the resulting controllers remain reference trackers and are not directly usable as task policies. We propose a three-stage pipeline that turns motion-imitation skills into a reusable hybrid motion prior (HMP) for humanoid locomotion. First, an expert policy is trained to imitate retargeted human motion-capture clips. Second, the expert is distilled into a frozen architecture composed of a proprioceptive encoder, a residual vector-quantized (RVQ) codebook, and an action decoder. Third, task-level policies are trained to solve locomotion tasks by selecting discrete codebook entries while the HMP remains frozen. We evaluate the method on velocity tracking, point-goal navigation, and fall-recovery velocity tracking in simulation, and deploy the velocity-tracking policy on a real Unitree G1 robot. The distillation process preserves the tracking behavior of the expert, while the resulting HMP can be reused without retraining as the action interface for different downstream locomotion policies. The learned HMP reveals an interpretable codebook structure in which the number of active RVQ stages modulates the available gait patterns. We further show that training the codebook with the rotation trick improves latent organization and reduces downstream falls compared with a standard straight-through estimator.