Search papers, labs, and topics across Lattice.
This paper introduces a cost-matching approach to train MPC controllers for humanoid locomotion using RL, where the MPC cost function is optimized to match the action-value function derived from high-fidelity trajectory data. By minimizing the discrepancy between MPC-predicted costs and observed returns, the method achieves efficient gradient-based learning without repeatedly solving the MPC problem during training. Simulation results on a commercial humanoid platform show improved locomotion performance and robustness compared to manually tuned controllers.
Forget painstakingly tuning MPC controllers by hand: this method learns optimal humanoid locomotion policies by aligning MPC cost functions with high-fidelity RL data.
In this paper, we propose a cost-matching approach for optimal humanoid locomotion within a Model Predictive Control (MPC)-based Reinforcement Learning (RL) framework. A parameterized MPC formulation with centroidal dynamics is trained to approximate the action-value function obtained from high-fidelity closed-loop data. Specifically, the MPC cost-to-go is evaluated along recorded state-action trajectories, and the parameters are updated to minimize the discrepancy between MPC-predicted values and measured returns. This formulation enables efficient gradient-based learning while avoiding the computational burden of repeatedly solving the MPC problem during training. The proposed method is validated in simulation using a commercial humanoid platform. Results demonstrate improved locomotion performance and robustness to model mismatch and external disturbances compared with manually tuned baselines.
