Search papers, labs, and topics across Lattice.
The paper introduces Latent Spatio-Temporal VLA (LaST-VLA), a novel framework for autonomous driving that performs vision-language-action reasoning in a continuous, physically grounded latent space. LaST-VLA uses a dual-feature alignment mechanism to distill geometric constraints from 3D foundation models and dynamic foresight from world models into the latent space, mitigating issues of semantic-perceptual decoupling. The method achieves state-of-the-art performance on NAVSIM v1 and v2, as well as strong results on SURDS and NuDynamics benchmarks, demonstrating improved spatial-temporal reasoning.
Ditch the clunky text-based reasoning: LaST-VLA achieves new benchmarks in autonomous driving by thinking in a physically-grounded, latent spatio-temporal space.
While Vision-Language-Action (VLA) models have revolutionized autonomous driving by unifying perception and planning, their reliance on explicit textual Chain-of-Thought (CoT) leads to semantic-perceptual decoupling and perceptual-symbolic conflicts. Recent shifts toward latent reasoning attempt to bypass these bottlenecks by thinking in continuous hidden space. However, without explicit intermediate constraints, standard latent CoT often operates as a physics-agnostic representation. To address this, we propose the Latent Spatio-Temporal VLA (LaST-VLA), a framework shifting the reasoning paradigm from discrete symbolic processing into a physically grounded Latent Spatio-Temporal CoT. By implementing a dual-feature alignment mechanism, we distill geometric constraints from 3D foundation models and dynamic foresight from world models directly into the latent space. Coupled with a progressive SFT training strategy that transitions from feature alignment to trajectory generation, and refined via Reinforcement Learning with Group Relative Policy Optimization (GRPO) to ensure safety and rule compliance. \method~setting a new record on NAVSIM v1 (91.3 PDMS) and NAVSIM v2 (87.1 EPDMS), while excelling in spatial-temporal reasoning on SURDS and NuDynamics benchmarks.
