Track synthesis, materials and catalysis as it is published.
Search papers, labs, and topics across Lattice.
WAVE-0 integrates pretrained Vision-Language-Action (VLA) policies with a lightweight latent world model to enable explicit future consequence prediction for robotic manipulation. By conditioning the VLA's action expert on these predicted futures, the framework unifies latent planning, future prediction, and action generation without requiring costly video generation or pixel reconstruction. This approach achieves state-of-the-art performance across multiple benchmarks, including significant real-world success rate improvements, demonstrating robust manipulation and generalization capabilities.
A lightweight latent world model directly conditions VLA action generation on predicted future consequences, boosting real-world robotic success rates from 38.3% to 73.3% without pixel-level video prediction.
Vision-language-action (VLA) policies excel at generalist robotic manipulation but generate actions without explicitly modeling their environmental consequences. World action models (WAMs) incorporate future prediction, yet most rely on costly video generation, while latent alternatives either use predicted futures only as auxiliary targets or infer latent actions from suboptimal visual transitions through costly large-scale video pretraining. We introduce WAVE-0 (World-model-Augmented VLA Execution), a framework that bridges VLAs and WAMs through a lightweight latent world model. By connecting the semantic understanding of pretrained VLAs with explicit future prediction, WAVE-0 allows anticipated action consequences to directly guide action generation. Built on a pretrained VLA, its 257M world model translates VLM-generated latent action plans into predicted future representations that condition the action expert, unifying latent planning, future prediction, and action generation. The world model is trained directly on ground-truth robot actions with a counterfactual ranking objective, requiring neither pixel reconstruction nor large-scale video pretraining. WAVE-0 achieves success rates of 91.47% on RoboTwin 2.0 and 98.7% on LIBERO, along with 88.0%, 61.4%, and 75.0% on LIBERO-Plus, LIBERO-Pro, and LIBERO-Para, respectively. On real-world tasks, it improves the success rate of π_{0.5} from 38.3% to 73.3%. These results demonstrate strong manipulation performance and generalization across diverse distribution shifts.