Search papers, labs, and topics across Lattice.
DriveZero eliminates the dependency on human driving logs in end-to-end autonomous driving by decoupling representation learning from closed-loop action optimization. The framework trains an unannotated visual backbone consolidated from frozen vision foundation models and a privileged RL teacher policy optimized via PPO in interactive log-replay worlds, distilling them into an integrated camera-only planner. Across benchmarks, it outperforms the human Log-Replay expert with a 93.57 score on nuPlan and establishes new state-of-the-art results on NAVSIMv1, NAVSIMv2, and closed-loop HUGSIM without using any human trajectory supervision.
Human trajectory logs are no longer the performance ceiling for autonomous driving: closed-loop reinforcement learning paired with distilled foundation models outperforms human demonstration baselines across major open and closed-loop benchmarks.
Most end-to-end autonomous-driving systems learn by imitating human driving logs, leaving their learned behavior constrained by the quality and behavioral coverage of the recorded trajectories. This report presents DriveZero, an end-to-end system that learns driving behavior beyond human demonstrations. It decomposes driving into a perception model and an action model, pretrains each in the regime best suited to it, and combines them into one end-to-end planner. The two models call for different learning recipes: perception must understand the world, and benefits from massive and diverse visual data; action must interact with it, and requires closed-loop feedback. On the action side, we introduce DriveRL, a mixed-agent closed-loop reinforcement-learning framework. It converts real driving logs into interactive worlds, where a privileged teacher policy is trained with PPO through closed-loop rollouts. For the perception model, DriveVFM consolidates multiple frozen vision foundation models, including DINOv3, SigLIP2, SAM and Depth Anything V2, into a single backbone from raw images alone, requiring no task-specific annotations. DriveZero then unifies the two: a camera-only planner that distills the frozen DriveRL teacher through its rolled-out trajectories. The goal-conditioned teacher can moreover be queried under augmented driving intents, yielding diverse, goal-consistent supervision that logged data cannot provide. On nuPlan, DriveRL with value-guided test-time action search achieves a mean score of 93.57 across the Val14, Test14-hard, and Test14-random community splits in both non-reactive and reactive modes, exceeding the Log-Replay expert on all three splits. DriveZero achieves state-of-the-art performance on NAVSIMv1, NAVSIMv2 and the closed-loop HUGSIM benchmark without any human trajectory supervision.
