Search papers, labs, and topics across Lattice.
This paper introduces FIRE-VLA, a failure-informed self-evolution framework designed to enhance vision-language-action models in autonomous driving by leveraging unresolved failures as privileged supervision for policy improvement. By employing group relative policy optimization (GRPO) alongside a self-distillation approach, the method allows a frozen model to guide the learning process based on low-reward, low-diversity trajectory groups. The results demonstrate that FIRE-VLA significantly reduces mean L2 error and persistent failure rates, indicating a targeted improvement in handling severe rollout failures without necessitating a larger external teacher model.
Transforming unresolved failures into a powerful learning signal, FIRE-VLA reduces mean L2 error in autonomous driving models by nearly 19% while maintaining policy efficiency.
Reinforcement learning improves autonomous-driving vision-language-action (VLA) models by evaluating trajectories sampled from the current policy. Group relative policy optimization (GRPO) learns from reward differences within each rollout group. When all sampled trajectories are poor, this relative signal can rank failures without identifying behavior outside the failed region. We introduce FIRE-VLA, a failure-informed self-evolution framework that converts such unresolved failures into privileged supervision for the next policy. Low-reward, low-diversity groups trigger self-distillation from a frozen round-start copy of the same model. Teacher and student have the same parameter scale, but only the teacher observes the hidden future trajectory. Supervision follows the student's generated prefix and is restricted to answer tokens, while GRPO remains active for every group. The updated policy supplies the teacher for the next round, allowing the routed failure distribution to change with the policy without requiring a larger external teacher. Starting from the same Qwen2.5-VL-3B SFT checkpoint, the comparison matches student rollout and policy-update counts. On 6,019 examples from 150 held-out nuScenes scenes, FIRE-VLA retains comparable single-sample planning, reduces G=4 mean L2 from 1.848 to 1.500 m, and lowers evaluation-persistent failure prevalence from 13.03% to 11.20%. The reduction in mean error arises mainly from rare severe rollouts rather than uniform improvement across ordinary trajectories.
