Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces the Reference Dataset Alignment Method (ReDAM) and Unified-weather-edit to enhance the fidelity of weather simulations for autonomous vehicle perception tasks. By aligning weather intensity and particle positioning across multiple sensors, the authors demonstrate that non-aligned simulations lead to overly optimistic performance in 3D detection models. The results show that aligned multi-sensor simulations significantly improve robustness in 3D object detection tasks when existing sensor fusion models are fine-tuned on them.
Aligned weather simulations can drastically improve the reliability of 3D object detection in autonomous vehicles operating in adverse conditions.
Perception tasks for autonomous vehicles need to work satisfactorily in adverse weather conditions. Due to lack of real-world weather datasets, weather simulations are a promising alternative. To ensure simulations closely mirror real-world weather data, it's crucial that they represent the same weather characteristics, including severity and particle positioning, across different sensors. To achieve this, we propose the Reference Dataset Alignment Method (ReDAM) for weather intensity alignment in fog and Unified-weather-edit (inspired by Weather-edit[1]) for particle positioning alignment in rain and snow. We validate both alignment methods using statistical and geometrical tests, respectively. We find that 3D detection models for non-aligned versions tend to be overly optimistic as compared to aligned versions. We also show the aligned-multi-sensor simulation's effectiveness for achieving robustness for 3D object detection task by finetuning existing sensor fusion models on it.