Search papers, labs, and topics across Lattice.
This paper introduces a two-stage reinforcement learning framework for quadruped robots that balances locomotion performance with motor thermal safety. First, a nominal policy is pre-trained for locomotion, then a residual policy is trained to provide thermal-aware corrective actions. Experiments show the resulting policy enables stable locomotion for over 13 minutes with a 3kg payload, while a nominal policy overheats in 5 minutes.
Quadruped robots can walk nearly three times longer with heavy payloads by learning a thermal-aware policy on top of a standard locomotion controller.
Motor thermal management is often overlooked in the context of electrically-actuated robots, particularly legged robots, but motor overheating is a key factor that limits long-duration locomotion especially under payload conditions. This paper integrates a whole-body thermal model of a quadruped robot into the reinforcement learning pipeline to update motor temperatures, and proposes a two-stage training framework for motor thermal management. In this framework, a nominal policy is first pre-trained as a locomotion baseline capable of traversing diverse terrains. A residual policy is then trained on top of the nominal policy to provide corrective actions based on the robot's thermal state, ensuring high performance under low-temperature conditions and preventing motor overheating under high-temperature conditions. Simulation results demonstrate that the proposed policy achieves an effective balance between motor thermal safety and locomotion performance. Real-world experiments on a Unitree A1 quadruped robot further validate the approach: under a 3 kg payload, the robot achieves stable locomotion across multiple terrains for over 13 minutes, while the nominal policy alone leads to motor overheating in about 5 minutes.
