Search papers, labs, and topics across Lattice.
This paper explores distilling the reasoning capabilities of large Vision-Language-Action (VLA) models into smaller, vision-only driving models for improved efficiency. They use a combination of latent feature distillation and ground-truth trajectory supervision to train a student model, Orion-Lite, from the ORION VLA teacher. Orion-Lite achieves a new state-of-the-art driving score of 80.6 on the Bench2Drive benchmark, even outperforming its teacher model.
A vision-only driving model, distilled from a massive VLA teacher, not only matches but *exceeds* its teacher's performance, proving that there's still headroom in vision-centric architectures for autonomous driving.
Leveraging the general world knowledge of Large Language Models (LLMs) holds significant promise for improving the ability of autonomous driving systems to handle rare and complex scenarios. While integrating LLMs into Vision-Language-Action (VLA) models has yielded state-of-the-art performance, their massive parameter counts pose severe challenges for latency-sensitive and energy-efficient deployment. Distilling LLM knowledge into a compact driving model offers a compelling solution to retain these reasoning capabilities while maintaining a manageable computational footprint. Although previous works have demonstrated the efficacy of distillation, these efforts have primarily focused on relatively simple scenarios and open-loop evaluations. Therefore, in this work, we investigate LLM distillation in more complex, interactive scenarios under closed-loop evaluation. We demonstrate that through a combination of latent feature distillation and ground-truth trajectory supervision, an efficient vision-only student model \textbf{Orion-Lite} can even surpass the performance of its massive VLA teacher, ORION. Setting a new state-of-the-art on the rigorous Bench2Drive benchmark, with a Driving Score of 80.6. Ultimately, this reveals that vision-only architectures still possess significant, untapped potential for high-performance reactive planning.
