Search papers, labs, and topics across Lattice.
This paper introduces SpanVLA, a VLA model for autonomous driving that combines autoregressive reasoning with a flow-matching action expert to improve action generation latency. SpanVLA uses a flow-matching policy conditioned on historical trajectories to efficiently plan future actions based on vision and reasoning guidance from a VLM. The model is further enhanced with a GRPO-based post-training method that learns from both positive and negative driving samples, and is evaluated on a new real-world driving reasoning dataset (mReasoning).
SpanVLA slashes action generation latency in autonomous driving by bridging VLMs with flow-matching, while also learning from driving mistakes to boost robustness.
Vision-Language-Action (VLA) models offer a promising autonomous driving paradigm for leveraging world knowledge and reasoning capabilities, especially in long-tail scenarios. However, existing VLA models often struggle with the high latency in action generation using an autoregressive generation framework and exhibit limited robustness. In this paper, we propose SpanVLA, a novel end-to-end autonomous driving framework, integrating an autoregressive reasoning and a flow-matching action expert. First, SpanVLA introduces an efficient bridge to leverage the vision and reasoning guidance of VLM to efficiently plan future trajectories using a flow-matching policy conditioned on historical trajectory initialization, which significantly reduces inference time. Second, to further improve the performance and robustness of the SpanVLA model, we propose a GRPO-based post-training method to enable the VLA model not only to learn from positive driving samples but also to learn how to avoid the typical negative behaviors and learn recovery behaviors. We further introduce mReasoning, a new real-world driving reasoning dataset, focusing on complex, reasoning-demanding scenarios and negative-recovery samples. Extensive experiments on the NAVSIM (v1 and v2) demonstrate the competitive performance of the SpanVLA model. Additionally, the qualitative results across diverse scenarios highlight the planning performance and robustness of our model.
