Search papers, labs, and topics across Lattice.
This paper addresses the embodiment gap in humanoid co-speech motion generation by introducing PhysDrift, a framework that directly predicts executable joint trajectories from speech, bypassing human-centric motion representations. The authors demonstrate that existing methods compress motion diversity and weaken synchronization between prosody and motion, leading to less expressive humanoid behaviors. Through extensive experiments, PhysDrift shows significant improvements in speech-motion alignment, physical plausibility, and real-time interaction capabilities, establishing a new standard for humanoid motion generation.
Humanoid robots can now generate co-speech motions that are not only expressive but also physically executable, bridging the embodiment gap that has long hindered their performance.
Humanoid robots require co-speech motions that are not only expressive and speech-aligned, but also physically executable under embodiment constraints. Existing co-speech generation pipelines are predominantly human-centric: motions are first generated in human-body representations such as SMPL-X and subsequently retargeted to humanoid robots. In this work, we identify a fundamental embodiment gap in this paradigm, where the mismatch between human motion manifolds and humanoid embodiment constraints disrupts embodiment consistency during motion transfer and physical execution. Through extensive analysis, we show that although retargeting can preserve coarse motion semantics, it significantly compresses motion diversity and weakens prosody-motion synchronization, limiting expressive humanoid behaviors. To address this problem, we first propose IK-EER, a prosody-preserving humanoid motion curation framework that jointly optimizes kinematic feasibility and speech-motion temporal alignment during retargeting. Building upon the curated robot-native motion dataset, we further introduce PhysDrift, an embodiment-aware co-speech motion generation framework that directly predicts executable humanoid joint trajectories from speech without relying on intermediate human-body representations. Unlike conventional human-centric pipelines, PhysDrift maintains embodiment consistency throughout both training and inference while incorporating physical regularization to stabilize robot motion dynamics. Extensive experiments and real-world humanoid deployment demonstrate that embodiment-aware robot-native generation substantially improves speech-motion alignment, physical plausibility, motion smoothness, inference efficiency, and real-time interaction capability.
