Search papers, labs, and topics across Lattice.
This paper introduces VLAFlow, a unified framework for comparing different training paradigms in vision-language-action (VLA) models, leveraging a diverse dataset of approximately 5,000 hours from various robotic sources. The study evaluates four training approaches鈥攁ction-only, language-supervised co-training, future latent alignment, and their combination鈥攗sing a consistent architecture and action space, revealing that language supervision and future latent alignment significantly enhance model generalization and transferability. The key finding is that combining these signals leads to the most stable performance across multiple benchmarks, highlighting the importance of integrating language and latent representations for improved action supervision in heterogeneous environments.
Combining language supervision with future latent alignment in VLA models leads to unprecedented stability and transfer performance across diverse robotic tasks.
Vision-language-action models (VLAs) have recently advanced robotic manipulation, yet the effects of different robot-data pre-training paradigms remain difficult to compare because existing models often differ in architecture, data, action space, and evaluation protocol. We present VLAFlow (Vision-Language-Action Flow), a unified flow-matching framework for controlled comparison of VLA training objectives. Using a heterogeneous robot corpus, OXEMix, containing approximately 5,000 hours of data from DROID, OpenX-Embodiment, OpenX-Augmented, and RoboCOIN, we evaluate four paradigms under the same pi0-style architecture, shared VLM backbone, action expert, and 14-dimensional action space: action-only modeling (MindPI), language-supervised co-training (MindLPI), future latent alignment (MindWPI), and their combination (MindLWPI). Experiments on LIBERO, LIBERO-Plus, and SimplerEnv show that action-only pre-training is sensitive to heterogeneous data. In contrast, language supervision helps preserve vision-language generalization, while future latent alignment improves state-transition and action-outcome modeling. By combining both signals, MindLWPI achieves the most stable overall transfer performance across benchmarks. These results suggest a meta-action space view: language and future latent representations provide complementary intermediate constraints that make heterogeneous action supervision smoother and more transferable.
