Search papers, labs, and topics across Lattice.
Qwen-Drive-1.0 is a vision-language foundation model designed for autonomous driving that integrates 3D perception, visual question answering, and motion planning into a cohesive framework. By employing a bird's-eye-view perception head, the model effectively performs 3D object detection and semantic segmentation, while a Planning Expert utilizes shared representations to predict future ego trajectories. Experimental results indicate that Qwen-Drive-1.0 achieves strong performance in 3D perception and motion planning, maintaining general vision-language capabilities throughout.
Strong 3D perception and competitive motion planning in autonomous driving are achieved without sacrificing general vision-language understanding.
We present Qwen-Drive-1.0, an initial step towards a vision-language foundation model for autonomous driving. Qwen-Drive-1.0 retains the architecture of the pretrained vision-language model (VLM) and integrates 3D perception, visual question answering, and motion planning within a unified framework. An external bird's-eye-view (BEV) perception head jointly performs 3D object detection, semantic occupancy prediction, and BEV map segmentation. It serves as a probe of the 3D information accessible from the shared representations and provides an explicit, inspectable interface to 3D scene structure. A Planning Expert conditions on shared VLM representations to generate future ego trajectories. A staged training recipe combines driving supervision with general-purpose vision-language data to acquire driving-specific competence while helping preserve broad visual understanding and instruction-following capabilities. Experiments demonstrate strong 3D perception and driving scene understanding while largely preserving general vision-language capability. Comprehensive evaluations across open-loop, pseudo-closed-loop, and closed-loop settings further show highly competitive motion-planning performance.
