Search papers, labs, and topics across Lattice.
InternVLA-A1.5 integrates pretrained vision-language models (VLMs) with future prediction to enhance robot manipulation policies by maintaining semantic integrity and leveraging learned dynamics. The approach innovatively recasts future prediction as a latent-querying problem, utilizing learnable foresight tokens to condense task-relevant future information while relying on a frozen pretrained video generation model. This method not only preserves semantics for superior compositional generalization in real-world tasks but also achieves the best performance across six simulation benchmarks, demonstrating its effectiveness in long-horizon execution scenarios.
By preserving the semantics of pretrained models while achieving superior compositional generalization, InternVLA-A1.5 redefines how robots can learn and execute complex tasks.
Unified models for robot manipulation aim to equip one policy with both the semantic priors of pretrained VLMs and the physical dynamics learned through future prediction. In practice, existing designs tend to erode the semantics of the pretrained backbone, suffer interference among heterogeneous objectives, and learn future prediction from scratch in pixel space, leaving the dynamics priors of pretrained video generators unexploited. We present InternVLA-A1.5, which builds the policy on a native VLM backbone that keeps training on VQA and subtask prediction, and attaches a lightweight unified expert for continuous action generation. Future prediction is recast as a latent-querying problem, where a small set of learnable foresight tokens condenses the task-relevant future into a compact latent code under the supervision of a frozen pretrained video generation model, so the policy inherits world-model dynamics priors without ever learning pixel-level generation. The video branch is discarded at inference, keeping real-time control. Pretrained on 1.2M robot episodes and 3M multimodal samples, InternVLA-A1.5 achieves the best overall results on all six simulation benchmarks. In the real world, the preserved semantics deliver the strongest compositional generalization on held-out instruction bindings, and the two designs together sustain long-horizon execution.
