Search papers, labs, and topics across Lattice.
Sensor-Conditioned Diffusion Policies (SCDP) are introduced to enable humanoid locomotion using only onboard sensors, removing the need for explicit state estimation. SCDP uses mixed-observation training, where a diffusion model conditions on sensor histories but is supervised to predict privileged future state-action trajectories, forcing implicit state estimation. The method incorporates restricted denoising, context distribution alignment, and context-aware attention masking to improve performance and prevent train-deploy mismatch, achieving near-perfect velocity control and robust real-robot locomotion on a G1 humanoid.
Humanoid robots can now walk robustly in the real world using only onboard sensors, thanks to a new diffusion policy that implicitly learns state estimation.
Distilling humanoid locomotion control from offline datasets into deployable policies remains a challenge, as existing methods rely on privileged full-body states that require complex and often unreliable state estimation. We present Sensor-Conditioned Diffusion Policies (SCDP) that enables humanoid locomotion using only onboard sensors, eliminating the need for explicit state estimation. SCDP decouples sensing from supervision through mixed-observation training: diffusion model conditions on sensor histories while being supervised to predict privileged future state-action trajectories, enforcing the model to infer the motion dynamics under partial observability. We further develop restricted denoising, context distribution alignment, and context-aware attention masking to encourage implicit state estimation within the model and to prevent train-deploy mismatch. We validate SCDP on velocity-commanded locomotion and motion reference tracking tasks. In simulation, SCDP achieves near-perfect success on velocity control (99-100%) and 93% tracking success in AMASS test set, performing comparable to privileged baselines while using only onboard sensors. Finally, we deploy the trained policy on a real G1 humanoid at 50 Hz, demonstrating robust real robot locomotion without external sensing or state estimation.
