Track manipulation, locomotion and embodied systems.
Search papers, labs, and topics across Lattice.
GAE establishes a unified learning framework for low-latency humanoid whole-body teleoperation trained on a standardized multi-source human motion dataset spanning video, mocap, and animation. To bridge physical embodiment gaps and transmission delays, the architecture combines a two-stage generator-executor distillation pipeline with a latency-conditioned anticipation mechanism. Deployed zero-shot on Unitree G1 and Westlake O1 robots, the framework achieves highly synchronized, real-time tracking of dynamic and expressive whole-body behaviors.
Decoupling motion retargeting into a privileged generator and an anticipatory executor enables physical humanoids to mirror agile, expressive human motions in real time despite severe latency and embodiment mismatches.
Humanoid avatars extend human physical presence beyond the body, enabling people to participate in social, service, and labor activities through remotely operated robots. This requires teleoperation systems capable of realizing diverse and dynamic whole-body behaviors while maintaining responsive human-robot synchronization. We present General Action Expert(GAE), a unified learning framework for general-purpose, low-latency humanoid whole-body teleoperation. To cover diverse human behaviors, GAE builds a large-scale human motion dataset from heterogeneous sources, including videos, animations, and motion capture, followed by standardization and augmentation. GAE then addresses the noise and embodiment mismatch in human motions with a two-stage training paradigm: a privileged generator policy first tracks human motion references in simulation and rolls out feasible humanoid trajectories; a deployable executor policy then learns to track these generated trajectories under curriculum domain randomization. For responsive human-robot synchronization, GAE introduces a latency-conditioned anticipation mechanism that adaptively compensates for end-to-end delay during real-time teleoperation. Simulation and real-world experiments on Unitree G1 and Westlake O1 robots demonstrate that GAE enables humanoids to smoothly mirror diverse, agile, and expressive human behaviors. Project website: https://wangyf0928.github.io/gae-wlrobotics/