Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces Stubborn, a unified reinforcement learning framework designed to enhance humanoid motion tracking and facilitate fall recovery by addressing the limitations of existing methods that treat these tasks separately. By employing an asymmetric Actor-Critic architecture, Stubborn incorporates a yaw-aligned tracking representation and a Bernoulli-based probabilistic termination mechanism, allowing for effective exploration of recovery behaviors in unstable states. Experimental results demonstrate that Stubborn not only achieves competitive performance compared to state-of-the-art methods but also significantly improves robustness through its adaptive sampling strategy and termination mechanism.
A novel probabilistic termination mechanism allows humanoid robots to explore fall recovery behaviors, enhancing robustness in motion tracking under disturbances.
Recent reinforcement learning approaches have shown great promise in improving humanoid motion tracking performance and achieving fall recovery under disturbances. However, most existing works treat motion tracking and fall recovery as different tasks and require multi-stage training with specialized recovery rewards and/or separate recovery policies. Moreover, existing reinforcement learning-based methods often terminate training episodes immediately after severe tracking failures, limiting recovery-oriented exploration in unstable or fallen states. To address the above issues, we propose Stubborn, a streamlined and unified reinforcement learning framework to achieve robust humanoid motion tracking and fall recovery. Specifically, Stubborn uses an asymmetric Actor-Critic architecture and consists of three major components. First, a yaw-aligned tracking representation is adopted to reduce sensitivity to global drift and heading disturbances while preserving gravity-related balance information. Second, we introduce a Bernoulli-based probabilistic termination mechanism that enables the policy to encourage exploration of fall-recovery behaviors under varying failure modes. Third, we propose a probabilistic termination and tracking-error-driven strategy that dynamically reshapes the sampling distribution based on tracking performance, increasing the training efficiency for difficult motion segments and unstable states. Extensive comparisons with SOTA methods and ablation studies show that Stubborn achieved competitive performance, and the proposed probabilistic termination mechanism and adaptive sampling strategy contributed to the performance and robustness gains. For real-world demonstrations, please refer to https://aislab-sustech.github.io/Stubborn/.