Search papers, labs, and topics across Lattice.
This paper introduces Tree Learning, a novel continual learning framework for humanoid robots designed to mitigate catastrophic forgetting in multi-skill learning scenarios. The framework employs a hierarchical parameter inheritance mechanism, reusing parameters from a root node to provide motion priors for new skills, and incorporates a multi-modal feedforward adaptation mechanism for diverse motions. Experiments demonstrate that Tree Learning achieves higher rewards and 100% skill retention compared to simultaneous multi-task training, enabling seamless skill switching and real-time control, validated across simulated locomotion, interactive, and navigation tasks.
Achieve 100% skill retention in humanoid robots learning new skills by reusing motion priors in a hierarchical tree structure, outperforming multi-task training.
As reinforcement learning for humanoid robots evolves from single-task to multi-skill paradigms, efficiently expanding new skills while avoiding catastrophic forgetting has become a key challenge in embodied intelligence. Existing approaches either rely on complex topology adjustments in Mixture-of-Experts (MoE) models or require training extremely large-scale models, making lightweight deployment difficult. To address this, we propose Tree Learning, a multi-skill continual learning framework for humanoid robots. The framework adopts a root-branch hierarchical parameter inheritance mechanism, providing motion priors for branch skills through parameter reuse to fundamentally prevent catastrophic forgetting. A multi-modal feedforward adaptation mechanism combining phase modulation and interpolation is designed to support both periodic and aperiodic motions. A task-level reward shaping strategy is also proposed to accelerate skill convergence. Unity-based simulation experiments show that, in contrast to simultaneous multi-task training, Tree Learning achieves higher rewards across various representative locomotion skills while maintaining a 100% skill retention rate, enabling seamless multi-skill switching and real-time interactive control. We further validate the performance and generalization capability of Tree Learning on two distinct Unity-simulated tasks: a Super Mario-inspired interactive scenario and autonomous navigation in a classical Chinese garden environment.
