Search papers, labs, and topics across Lattice.
This paper introduces a two-stage, model-based control framework for generating and executing dynamic whole-body dance motions on humanoid robots. The framework combines offline motion generation via QP-based retargeting and trajectory optimization with online motion execution using centroidal dynamics-based MPC, with proactive swing foot placement adjustments. Experiments on the Kuavo 4Pro humanoid robot, including a live public performance, demonstrate the effectiveness of the approach, highlighting the importance of longer prediction horizons for both motion expressiveness and stability.
Humanoid robots can now groove in sync for a full four minutes on stage, thanks to a model-based control framework that anticipates disturbances and proactively adjusts foot placement.
This paper presents an integrated model-based framework for generating and executing dynamic whole-body dance motions on humanoid robots. The framework operates in two stages: offline motion generation and online motion execution, both leveraging future state prediction to enable robust and dynamic dance motions in real-world environments. In the offline motion generation stage, human dance demonstrations are captured via a motion capture (MoCap) system, retargeted to the robot by solving a Quadratic Programming (QP) problem, and further refined using Trajectory Optimization (TO) to ensure dynamic feasibility. In the online motion execution stage, a centroidal dynamics-based Model Predictive Control (MPC) framework tracks the planned motions in real time and proactively adjusts swing foot placement to adapt to real world disturbances. We validate our framework on the full-size humanoid robot Kuavo 4Pro, demonstrating the dynamic dance motions both in simulation and in a four-minute live public performance with a team of four robots. Experimental results show that longer prediction horizons improve both motion expressiveness in planning and stability in execution.
