Track manipulation, locomotion and embodied systems.
Search papers, labs, and topics across Lattice.
To resolve the tension between the adaptability of reinforcement learning and the safety of classical gait generation, the authors anchor humanoid policy learning to an analytical Angular Momentum Linear Inverted Pendulum (ALIP) template. The framework establishes a step-to-step discrete exponential control barrier function (DECBF) that serves simultaneously as an RL reward-shaping signal during training and as a real-time safety filter on swing-foot placement. Evaluated on the Digit humanoid in MuJoCo, this hybrid approach substantially mitigates safety-violation events under external disturbances relative to unconstrained RL, while explicitly characterizing an inherent tradeoff between tracking precision and lateral safety margins.
Grounding RL footstep policies in discrete control barrier functions derived from reduced-order physics provides provable step-to-step safety filtering without sacrificing dynamic locomotion robustness.
Humanoid robots promise versatile mobility in cluttered, human-centric environments, but real deployment demands principled safety. Classical model-based gait generators yield interpretable motions but often lack the robustness and adaptability of modern reinforcement learning (RL) based approaches. We propose a model-informed reinforcement learning framework anchored to the analytical Angular Momentum Linear Inverted Pendulum (ALIP) template. We provide a step-to-step safety certificate for ALIP stepping via a discrete exponential control barrier function (DECBF) and use it as (i) a training-time shaping signal and (ii) a runtime action filter that minimally adjusts swing-foot placement to satisfy template-level constraints. Full-order safety is evaluated empirically on the Digit humanoid in MuJoCo with a whole-body controller stack. Compared to an unconstrained baseline, our approach reduces safety-violation events in the reported external-disturbance trial, while larger lateral-velocity transients reveal a safety-tracking tradeoff.