Search papers, labs, and topics across Lattice.
Cyclone introduces a novel latent diffusion framework for cycle-consistent weather editing that operates without the need for paired training data, addressing the limitations of existing synthetic data augmentation and physics-based models. By leveraging knowledge from image-text models, Cyclone generates realistic weather variations across diverse driving scenarios while preserving structural integrity. Experimental results indicate that Cyclone significantly enhances the performance of downstream perception tasks in autonomous driving, outperforming current baselines in realism and consistency.
Cyclone achieves realistic weather editing without paired data, revolutionizing how we train perception models for autonomous driving.
Reliable perception under diverse weather conditions remains a major challenge for autonomous driving systems. A common strategy to improve robustness is either to synthesize adverse weather conditions for training perception models or to apply weather-removal techniques to recover clean inputs. However, existing approaches typically rely on synthetic data augmentation or physics-based, task-specific models that require paired training data and often struggle to generate realistic weather effects or generalize robustly to out-of-domain scenarios. Toward this problem, we present Cyclone, a unified framework for weather editing based on latent diffusion, equipped with cycle-consistent constraints and knowledge from image-text models. Cyclone enables the generation of multiple weather conditions across diverse scenes while eliminating the need for paired data. Experimental results show that our approach produces more realistic, structure-preserving outputs than existing baselines and leads to consistent improvements across several downstream driving perception tasks. Furthermore, we demonstrate that Cyclone can be distilled to a video diffusion model for temporally consistent weather editing.
