Search papers, labs, and topics across Lattice.
This paper introduces JEPA-WAM, a latent world action model that integrates latent transition prediction with continuous action generation in a pretrained vision-language-embedding space. By leveraging a shared predictor, JEPA-WAM effectively captures the temporal structure between current and future observations while maintaining dense correspondence at the patch level. The model achieves state-of-the-art performance on the LIBERO-Plus benchmark, demonstrating its robustness and generalization capabilities in both simulated and real-world robotic manipulation tasks.
JEPA-WAM achieves a remarkable 79.2% on LIBERO-Plus without large-scale pretraining, setting a new benchmark for efficient robot control.
Robust robot control benefits from explicitly modeling state transitions, but video-generation world action models (WAMs) introduce substantial deployment cost. Existing latent WAMs avoid explicit future generation, but often compress predictive representations or separate predictive modeling from the representations used for action generation. We introduce JEPA-WAM, a latent WAM built in a pretrained V-JEPA space, which couples latent transition prediction with continuous action generation through a shared predictor. JEPA-WAM predicts a spatially structured joint current-future target that captures task-shared visual temporal structure between current and future observations, while preserving dense patch-level correspondence. Through the shared predictor, transition supervision directly shapes the backbone, from which dedicated representations are extracted for action prediction. The same design can also be instantiated in pretrained VLA policies while preserving their original perception and action pathways. On LIBERO-Plus, JEPA-WAM achieves 79.2%, the best result without large-scale robot-policy pretraining, while its pretrained $\pi_{0.5}$ instantiation reaches 86.3%, achieving the best overall performance. Experiments on RoboTwin 2.0 and real-world bimanual manipulation further demonstrate strong generalization under visual and spatial shifts.