Search papers, labs, and topics across Lattice.
This paper introduces X-Morph, a novel pipeline that transforms human motion data into effective locomotion and loco-manipulation policies for various non-humanoid legged robots. By employing a cross-morphology retargeting stage, the system generates kinematically plausible robot references that maintain the intent of the original human motions, which are then refined through reinforcement learning. Evaluations across different robotic platforms demonstrate that the resulting policies not only track diverse motions but also generalize well to unseen human movements, enabling applications such as video-based teleoperation and text-conditioned motion generation.
Large-scale human motion data can now be effectively repurposed to teach diverse non-humanoid robots, unlocking new capabilities in locomotion and manipulation.
Recent progress in humanoid behavior models has been driven in large part by abundant human motion data, but comparable motion data is scarce for non-humanoid legged robots such as quadrupeds, hexapods, and quadruped manipulators. A promising alternative is to repurpose human motion across embodiments; however, direct retargeting often produces motions that are visually plausible yet physically inconsistent or difficult to track under robot dynamics. We present X-Morph, a human-motion-to-robot-behavior pipeline that converts human motion into deployable locomotion and loco-manipulation policies for diverse non-humanoid legged morphologies. A cross-morphology retargeting stage converts human motions into kinematically plausible, intent-preserving robot references, which are then tracked by a privileged RL policy and distilled into a causal student policy. We evaluate X-Morph on three morphologically distinct platforms: a quadruped, a hexapod, and a quadruped equipped with a manipulator. The resulting policies track diverse retargeted motions, generalize to unseen human motions, and support downstream use cases including video-based teleoperation, behavior-prior control, and text-conditioned motion generation. These results suggest that large-scale human motion can serve as a substrate for learning broad, reusable behavior priors beyond humanoid robots. Project page: https://maker-rat.github.io/morph/
NUS