Search papers, labs, and topics across Lattice.
EvoDriveVLA addresses the challenges of degraded perception and planning instability in Vision-Language-Action models for autonomous driving by introducing a collaborative perception-planning distillation framework. This framework uses self-anchored visual distillation with trajectory-guided key-region awareness to regularize student representations, and oracle-guided trajectory distillation with future-aware trajectory refinement to guide student planning. Experiments show EvoDriveVLA achieves state-of-the-art performance in both open-loop and closed-loop autonomous driving evaluations.
Autonomous driving gets a boost: EvoDriveVLA's collaborative perception-planning distillation framework significantly enhances VLA model performance by tackling perception degradation and planning instability.
Vision-Language-Action models have shown great promise for autonomous driving, yet they suffer from degraded perception after unfreezing the visual encoder and struggle with accumulated instability in long-term planning. To address these challenges, we propose EvoDriveVLA-a novel collaborative perception-planning distillation framework that integrates self-anchored perceptual constraints and oracle-guided trajectory optimization. Specifically, self-anchored visual distillation leverages self-anchor teacher to deliver visual anchoring constraints, regularizing student representations via trajectory-guided key-region awareness. In parallel, oracle-guided trajectory distillation employs a future-aware oracle teacher with coarse-to-fine trajectory refinement and Monte Carlo dropout sampling to produce high-quality trajectory candidates, thereby selecting the optimal trajectory to guide the student's prediction. EvoDriveVLA achieves SOTA performance in open-loop evaluation and significantly enhances performance in closed-loop evaluation. Our code is available at: https://github.com/hey-cjj/EvoDriveVLA.