Search papers, labs, and topics across Lattice.
The paper introduces Robust Extreme Agility Learning (REAL), an end-to-end framework for enabling legged robots to perform robust parkour under noisy sensory conditions. REAL distills a cross-modal teacher policy into a student using a FiLM-modulated Mamba backbone for noise filtering and terrain memory, coupled with a physics-guided Bayesian state estimator for rigid-body consistency. Experiments on a Unitree Go2 demonstrate successful traversal of extreme obstacles with significant visual obstruction while maintaining real-time control.
Legged robots can now perform robust parkour with a 1-meter visual blind zone, thanks to a novel architecture that tightly couples vision, proprioception, and physics-based state estimation.
Extreme legged parkour demands rapid terrain assessment and precise foot placement under highly dynamic conditions. While recent learning-based systems achieve impressive agility, they remain fundamentally fragile to perceptual degradation, where even brief visual noise or latency can cause catastrophic failure. To overcome this, we propose Robust Extreme Agility Learning (REAL), an end-to-end framework for reliable parkour under sensory corruption. Instead of relying on perfectly clean perception, REAL tightly couples vision, proprioceptive history, and temporal memory. We distill a cross-modal teacher policy into a deployable student equipped with a FiLM-modulated Mamba backbone to actively filter visual noise and build short-term terrain memory actively. Furthermore, a physics-guided Bayesian state estimator enforces rigid-body consistency during high-impact maneuvers. Validated on a Unitree Go2 quadruped, REAL successfully traverses extreme obstacles even with a 1-meter visual blind zone, while strictly satisfying real-time control constraints with a bounded 13.1 ms inference time.
