Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study introduces an RL guided whole-body model predictive path integral (MPPI) framework that enhances humanoid robot control by integrating a pretrained RL policy as a sampling prior. The approach allows for dynamic adjustment of task objectives through modular MPPI cost terms, enabling real-time corrections without the need for retraining the RL policy. Simulations show that this method achieves stable high-rate control at 280 Hz, significantly improving task-level precision compared to a pure RL baseline.
By leveraging a pretrained RL policy as a sampling prior, this method achieves real-time adaptability in humanoid control without retraining, enhancing precision in complex tasks.
Humanoid robots require whole-body controllers that are both robust and precise in contact-rich environments. While deep reinforcement learning (RL) achieves robust stability, its behavior is tightly coupled to the training objective and command interface, making it difficult to add new feedback objectives without retraining. In this study, we propose an RL guided whole-body model predictive path integral (MPPI) framework that acts as an add-on feedback controller on top of a pretrained RL policy. Instead of using RL policy as the final controller, we use it as a sampling prior that biases MPPI rollouts toward dynamically feasible behaviors. Task objectives are specified through modular MPPI cost terms, and MPPI closes the loop by continuously correcting the RL prior online to satisfy these objectives without retraining the policy. Simulations on a 29-DoF Unitree G1 humanoid in MuJoCo demonstrate stable high-rate control (average 280~Hz). The proposed method improves task-level precision over a pure RL baseline under the same command interface. This is achieved by correcting systematic drift during straight walking and tracking additional whole-body reference signals imposed through the cost.