Search papers, labs, and topics across Lattice.
This paper introduces Lumo-2, a latent world-action model that enhances robot learning by generating actions through reasoning over latent space dynamics, focusing on physically grounded visual transitions. The authors identify that traditional reconstruction-based action tokenization leads to misalignment between representation quality and control performance, prompting the development of a multi-stage modality pre-alignment strategy. Empirical results demonstrate that Lumo-2 significantly outperforms existing vision-language-action and world-action model baselines, particularly in complex tasks requiring temporal reasoning and physical understanding.
Lumo-2 reveals that aligning action representations with latent world dynamics can dramatically enhance robot performance in complex manipulation tasks.
Learning, at its core, extends beyond memorization to the ability to reason and solve novel problems by navigating a space of possibilities. We introduce Lumo-2, a latent world-action model that generates actions by reasoning over world dynamics in latent space. The learned latent world dynamics capture physically grounded visual transitions, naturally encoding future possibilities and providing a unified substrate for cross-modal alignment. This formulation enables predictive reasoning akin to world modelling while remaining lightweight and focused on physical dynamics relevant to control. Central to our approach is the hypothesis that action generation quality is governed by the geometry of the latent space. We observe that standard reconstruction-based action tokenization objectives induce representations biased toward low-level signal fidelity, leading to misalignment between reconstruction quality and downstream control performance. To address this limitation, we propose a multi-stage modality pre-alignment strategy in which action representations are progressively aligned with latent world dynamics, vision, and language. This process enforces cross-modal consistency, promotes abstraction, and induces a structured latent space for predictive reasoning. We provide a systematic empirical study of latent world modelling and modality alignment, analyzing their roles in scaling laws and out-of-distribution generalization. Results show that Lumo-2 consistently outperforms strong vision-language-action (VLA) and world-action model (WAM) baselines, with gains on challenging real-world tasks requiring temporal reasoning, physical understanding, or high control complexity, including long-horizon and dexterous manipulation. These findings suggest that structured multimodal alignment and predictive reasoning are fundamental principles for advancing embodied intelligence.
