Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a model-assisted reinforcement learning framework that effectively addresses the challenges of bipedal locomotion over sparse terrain by integrating model-based and model-free approaches. The method involves generating a safe reference trajectory, training a teacher policy using a control Lyapunov function, and distilling this knowledge into a vision-based student policy. The results show significant improvements in sample efficiency and locomotion smoothness, with successful real-world deployment on a humanoid robot navigating challenging environments.
Achieving physically grounded locomotion on a humanoid robot navigating sparse footholds demonstrates a breakthrough in balancing precision and robustness in reinforcement learning.
Perceptive bipedal locomotion over sparse terrain remains a difficult challenge: model-based methods are precise but brittle to uncertainty, while model-free methods are robust but struggle to discover the precise, constrained motions required for safety-critical locomotion where small errors can cause catastrophic failures. We propose a model-assisted reinforcement learning (RL) framework that combines both perspectives in three steps: (1) generate a safe reference trajectory using simplified models; (2) train a privileged teacher policy guided by a control Lyapunov function (CLF) reward built around the safe reference trajectory; and (3) distill the teacher into a vision-based student policy. We show that this model-assistance procedure produces physically grounded locomotion, improving sample efficiency, reducing the need for a complex learning curriculum, and achieving smoother locomotion behavior alongside stepping stone performance comparable to model-free baselines. We validate our approach in simulation and demonstrate successful deployment on a Unitree G1 humanoid robot navigating sparse footholds with lateral constraints.