Search papers, labs, and topics across Lattice.
This paper introduces Extreme-RGMT, a two-stage continual learning framework designed to enhance robust generalist humanoid control by balancing the acquisition of highly dynamic skills with the preservation of everyday motor abilities. The method employs a generalist motion-tracking base policy trained on diverse data, followed by an asymmetric skill acquisition mechanism that prioritizes difficult dynamic motions while minimizing policy drift on previously mastered skills. Experimental results demonstrate that Extreme-RGMT achieves state-of-the-art performance in whole-body motion tracking, significantly improving the execution of challenging dynamic motions compared to existing approaches.
Achieving human-expert level control, Extreme-RGMT allows humanoid robots to master complex dynamic skills without sacrificing reliability in everyday tasks.
Humans can progressively acquire highly dynamic motor skills while preserving reliable everyday motor abilities. In contrast, existing humanoid controllers face a trade-off between generalist and specialist capabilities: generalist motion tracking policies struggle to reliably execute rare highly dynamic motions, whereas specialist training can degrade previously acquired behaviors. We introduce Extreme-RGMT, a two-stage continual learning framework for robust generalist humanoid control. The method first learns a generalist motion-tracking base policy from diverse multi-source motion data, then employs an asymmetric skill acquisition and capability consolidation mechanism to constrain policy drift on mastered motions while emphasizing difficult dynamic segments. To address the scarcity of highly dynamic motions, their high failure rates, and the resulting shortage of informative samples, Extreme-RGMT combines difficulty-aware sampling with advantage-prioritized trajectory resampling to emphasize critical segments. Experiments show that Extreme-RGMT achieves state-of-the-art generalist whole-body motion-tracking performance, including substantially improved completion of challenging highly dynamic motions. The resulting controller directly executes diverse unseen highly dynamic motions under fixed references and online inertial motion-capture inputs, advancing generalist whole-body motion-tracking controllers toward highly dynamic motor capabilities at the human-expert level.
