Search papers, labs, and topics across Lattice.
Heracles, a state-conditioned diffusion model, is introduced as a middleware layer between high-level reference motions and low-level physics trackers for humanoid control. This allows the system to behave as an identity map for precise tracking when the robot's state aligns with the reference, but seamlessly transitions to a generative synthesizer to produce natural recovery trajectories when encountering significant deviations. The approach enhances robustness against extreme perturbations, moving humanoid control towards a more general-purpose architecture.
Humanoid robots can now recover from extreme perturbations with more natural, human-like movements by using a diffusion model as a learned intermediary between high-level commands and low-level motor control.
Achieving general-purpose humanoid control requires a delicate balance between the precise execution of commanded motions and the flexible, anthropomorphic adaptability needed to recover from unpredictable environmental perturbations. Current general controllers predominantly formulate motion control as a rigid reference-tracking problem. While effective in nominal conditions, these trackers often exhibit brittle, non-anthropomorphic failure modes under severe disturbances, lacking the generative adaptability inherent to human motor control. To overcome this limitation, we propose Heracles, a novel state-conditioned diffusion middleware that bridges precise motion tracking and generative synthesis. Rather than relying on rigid tracking paradigms or complex explicit mode-switching, Heracles operates as an intermediary layer between high-level reference motions and low-level physics trackers. By conditioning on the robot's real-time state, the diffusion model implicitly adapts its behavior: it approximates an identity map when the state closely aligns with the reference, preserving zero-shot tracking fidelity. Conversely, when encountering significant state deviations, it seamlessly transitions into a generative synthesizer to produce natural, anthropomorphic recovery trajectories. Our framework demonstrates that integrating generative priors into the control loop not only significantly enhances robustness against extreme perturbations but also elevates humanoid control from a rigid tracking paradigm to an open-ended, generative general-purpose architecture.
