Track manipulation, locomotion and embodied systems.
Search papers, labs, and topics across Lattice.
To overcome embodiment-specific action bottlenecks in robotic learning, the authors introduce Universal Manipulation Representation (UMR), a formulation that decomposes manipulation into embodiment-agnostic object motion ("World Flow") and end-effector motion ("Ego Trajectory") coupled via $SE(3)$ conjugation. The representation is instantiated via WEPVLA, a 0.5B-parameter point-cloud Vision-Language-Action model paired with a contact-preserving 3D data augmentation strategy. The framework achieves 97.5% on LIBERO, 85.7% on RLBench, and attains 91.7% real-world success across heterogeneous robots zero-shot using only ~10 minutes of human demonstrations per task without any robot data.
Decoupling manipulation into object-centric world flow and robot-centric ego trajectories allows a compact 0.5B VLA to achieve 91.7% real-world robot manipulation directly from 10 minutes of human video demonstrations without collecting a single robot trajectory.
General-purpose embodied manipulation hinges on a unified action representation that generalizes across embodiments and scales readily. Yet existing policies rely on embodiment-specific action spaces, making cross-embodiment demonstrations difficult to leverage at scale and limiting transfer to new embodiments and spatial variations. To this end, we introduce Universal Manipulation Representation (UMR), a unified action representation that enables zero-shot skill transfer from human demonstrations to heterogeneous robots. UMR decomposes manipulation into two functionally distinct yet geometrically linked components: embodiment-agnostic World Flow, which describes task-relevant object motion in the world frame, and Ego Trajectory, which represents end-effector motion relative to the current pose. We instantiate UMR as World--Ego Point VLA (WEPVLA), a compact 0.5B-parameter policy that learns in the unified geometric action space through a dual-stream Point Action Adapter and a unified Point Action Expert, with an $SE(3)$ conjugation coupling the two components. To improve data efficiency, we complement UMR with a Data-Efficient Strategy (DES) that diversifies object configurations through stage-aware point-cloud editing while preserving demonstrated contact geometry. In simulation, WEPVLA achieves average success rates of 97.5\% on LIBERO and 85.7\% on the 10-task RLBench benchmark. In real-world experiments, a single policy trained on human demonstrations augmented by DES transfers zero-shot to diverse deployment conditions. With about 10 minutes of collected human demonstrations per task and no robot demonstrations, it achieves 91.7\% average success across six evaluation settings, compared with 60.8\% for HumanEgo. Code and additional materials are available at https://umr-wepvla.github.io/.