Search papers, labs, and topics across Lattice.
This paper introduces FrozenDrive, a novel framework for generating synthetic driving scenes using a parameter-free frozen diffusion model that maintains pre-trained knowledge while ensuring multi-view and temporal consistency. By leveraging rich driving-stack signals and text prompts, FrozenDrive employs a unique spatio-temporal attention mechanism to achieve cross-view alignment and temporal coherence without the need for fine-tuning. The results show that FrozenDrive can synthesize high-fidelity, globally coherent driving scenes, particularly in adverse conditions, leading to significant performance improvements in autonomous driving models trained on this augmented data.
FrozenDrive generates high-fidelity driving scenes under adverse conditions without sacrificing pre-trained model knowledge, outperforming existing methods.
Synthetic data for autonomous driving is surging, powered by diffusion models that promise scalable scene generation. Yet key obstacles remain, as enforcing multi-view and temporal consistency often relies on backbone fine-tuning or added layers, which erodes pre-trained knowledge and weakens text alignment. Models also stay close to the training distribution, struggling under adverse weather and unseen configurations, and fidelity favors frequent over rare classes. We address these gaps with FrozenDrive, a controllable generative framework that preserves a pretrained diffusion models knowledge while achieving strong consistency. FrozenDrive conditions on rich driving-stack signals and text prompts, and introduces knowledge-preserving spatio-temporal attention to impose cross-view alignment and temporal coherence in a single pass within a parameter-free frozen diffusion backbone. An additional object-focused constraint improves per-object fidelity for rare categories. Without any weather- or scene-specific fine-tuning, our model synthesizes globally coherent multi-view driving scenes from text, particularly under adverse and rare conditions, and surpasses prior baselines. On nuScenes, FrozenDrive augmented data significantly improves AD models performance, especially at night and in rain, demonstrating stronger robustness when trained with our scenario-targeted data.
