Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper addresses the challenge of energy-efficient quadrupedal locomotion by proposing a hierarchical reinforcement learning (HRL) framework that decouples low-level motion execution from high-level gait adaptation. The HRL approach explicitly minimizes the cost of transport (CoT) at the gait adaptation level, leading to significantly reduced energy consumption across diverse terrains and velocities. The framework achieves zero-shot sim-to-real transfer and demonstrates automatic speed-dependent gait transitions, outperforming baseline methods in both simulation and on a physical robot.
Quadrupedal robots can achieve up to 20% lower energy consumption by learning speed-dependent gaits with a hierarchical RL policy that explicitly optimizes cost of transport.
While energy efficiency is a critical objective for legged-robot locomotion control, achieving low energy consumption while maintaining robust performance across different velocity ranges and terrain conditions remains a key challenge. This is particularly true for end-to-end RL policies, where gait generation, motion execution, and energy optimization are tightly coupled, leading to high sensitivity to reward design. In this work, we propose a hierarchical reinforcement learning (HRL) framework that separates a high-frequency policy for stable and robust joint-level motion execution from low-frequency gait adaptation that explicitly minimizes the cost of transport (CoT). The three-stage Isaac-based training procedure enables zero-shot sim-to-real transfer with improved tracking accuracy, robustness, and energy efficiency. The learned hierarchy exhibits automatic speed-dependent gait adaptation, transitioning from pacing at low speeds to trotting at higher speeds. We validate the proposed approach in simulation against representative single-policy and hierarchical locomotion baselines, demonstrating reduced CoT over a broad range of commanded velocities, while maintaining robust locomotion across flat, uneven rough, and inclined terrains. We further demonstrate its practical feasibility through zero-shot deployment on a physical Unitree AlienGo quadruped.