Search papers, labs, and topics across Lattice.
This paper introduces FactorDrive, an innovative framework for end-to-end autonomous driving that enhances adaptive multi-step reasoning through the integration of planning-critical factors (PCFs). By utilizing large-scale instruction tuning and a novel chain-of-thought dataset (PCF-CoT), the framework grounds reasoning in spatial-physical evidence, allowing for scene-specific adaptations in planning. The implementation of Quality Search-Guided Group Relative Policy Optimization (QS-GRPO) further optimizes reasoning paths, resulting in superior trajectory planning performance on both open-loop and closed-loop benchmarks.
FactorDrive redefines autonomous driving by seamlessly integrating spatial-physical evidence into adaptive reasoning, achieving state-of-the-art planning performance.
Vision-language models (VLMs) have advanced scene understanding and enabled explicit reasoning in end-to-end autonomous driving. However, existing methods insufficiently integrate spatial-physical evidence into planning reasoning, while reasoning adaptation remains coarse-grained and falls short of scene-specific planning demands. Furthermore, reasoning-path optimization for higher planning quality remains largely unexplored in autonomous-driving post-training. To address these limitations, we propose FactorDrive, an end-to-end autonomous driving framework for adaptive multi-step reasoning driven by planning-critical factors (PCFs). We first perform large-scale driving-domain instruction tuning to establish foundational driving knowledge. Building on this foundation, we construct PCF-CoT, a chain-of-thought (CoT) dataset that grounds planning reasoning in trajectory-relevant spatial-physical evidence and organizes reasoning around scene-specific PCFs, enabling the composition and depth of reasoning paths to adapt to different planning demands. We further introduce Quality Search-Guided Group Relative Policy Optimization (QS-GRPO), which guides Monte Carlo Tree Search (MCTS) with trajectory-level planning rewards to discover reasoning paths with higher planning quality and uses the resulting responses to optimize the policy through GRPO, thereby improving trajectory planning performance. Extensive experiments on both open-loop (nuScenes) and closed-loop-oriented (NAVSIM) benchmarks demonstrate that FactorDrive achieves state-of-the-art planning performance.
Tsinghua AI