Search papers, labs, and topics across Lattice.
The paper introduces DyPES-VLA, a cross-embodiment Vision-Language-Action model that leverages shared dynamics priors to enhance robot manipulation across diverse embodiments. By employing a future-prediction objective on cross-embodiment data, the model effectively captures object motion and interaction changes, facilitating better transfer of learned behaviors. The embodiment-specific Mixture-of-Experts action head translates these dynamics into native action spaces, achieving state-of-the-art performance with success rates of 98.0% on LIBERO and notable results on RoboCasa-GR1 and RoboTwin~2.0.
Achieving 98.0% success in cross-embodiment manipulation without manual action alignment could redefine how we approach robot control across diverse platforms.
Vision-Language-Action (VLA) models have become a powerful paradigm for robot manipulation, but training a single generalist policy for heterogeneous robot embodiments remains an open problem. Existing methods have two main limitations. First, they underuse dynamics priors shared across diverse visual and interaction data, limiting cross-embodiment transfer. Second, they require extensive manual preprocessing to convert embodiment-specific actions into a common format. To overcome these limitations, we propose DyPES-VLA, a cross-embodiment VLA that learns shared Dynamics Priors and Embodiment-Specific control. First, we learn shared dynamics priors by training the vision-language model (VLM) with a future-prediction objective on cross-embodiment data, driving the shared query representation to capture object motion, contact, and interaction-induced scene changes. Second, an embodiment-specific Mixture-of-Experts (MoE) action head translates these shared dynamics priors into executable controls directly in each embodiment's native action space, without manually pre-aligning heterogeneous actions into a common format. This head shares attention layers to capture common temporal action structures, while its embodiment-specific feed-forward experts resolve the unique kinematic constraints and control semantics of distinct embodiments. As a generalist policy, our \ourmethod achieves state-of-the-art performance across simulation and real-world evaluations, reaching 98.0% success on LIBERO, 59.25% on RoboCasa-GR1, and 89.02% on RoboTwin~2.0.
