Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a robust reinforcement learning (RL) framework for quadrupedal locomotion that leverages Nvidia's Isaac Sim and Isaac Lab to bridge the sim-to-real gap. The framework achieves a zero-shot policy that performs effectively on physical hardware, specifically the Unitree Go1, demonstrating superior recovery from disturbances and comparable velocity tracking to the integrated controller. Key results indicate the system can achieve linear velocities of 2.0 m/s and angular velocities of 1.8 rad/s, highlighting its practical applicability in real-world scenarios.
Achieving zero-shot sim-to-real locomotion, this RL framework outperforms traditional controllers in both speed and disturbance recovery.
Learning-based approaches to locomotion have risen in popularity in recent years, showing the capability for complex legged locomotion and whole-body control. Reinforcement learning (RL), the primary learning-based approach for locomotion, often utilizes a high-performance simulation tool, providing a controlled and efficient training and development environment. However, policies that perform well in simulation frequently encounter unexpected challenges when deployed on a physical system, known as the sim-to-real gap. This work presents a robust RL locomotion framework capable of whole-body control. The proposed RL framework utilizes Nvidia’s new set of simulation tools, Isaac Sim, and its companion RL framework, Isaac Lab, for training, achieving a zero-shot sim-to-real policy. The performance of our policy is validated on physical hardware using the Unitree Go1, with experimental results showing similar velocity tracking performance to the quadrupeds’ integrated controller, with a greater ability to recover from large disturbances, and achieve linear velocities of 2.0 m/s and angular velocities of 1.8 rad/s.