Search papers, labs, and topics across Lattice.
This paper addresses the challenges of self-supervised depth estimation in autonomous driving under adverse weather conditions by introducing a self-training pipeline that employs multi-teacher distillation and robust radar fusion. The authors propose an Uncertainty-Aware Multi-Teacher Distillation method to generate diverse teacher models and utilize uncertainty modeling to enhance knowledge distillation. Their approach, combined with the POV-BEV Radar Fusion technique, significantly improves depth estimation accuracy, achieving state-of-the-art performance across various all-weather datasets.
Self-supervised depth estimation can now achieve state-of-the-art accuracy in adverse weather by effectively fusing radar and camera data through innovative multi-teacher distillation.
Self-supervised depth estimation is challenging for safe autonomous driving under various adverse weather conditions due to sensor perception degradation. These challenges arise from two main aspects. Firstly, adverse conditions can distort pixel correspondences and violate the assumptions embedded in the self-supervised loss function, leading to erroneous depth predictions. Secondly, while radar is a widely adopted sensor in adverse weather conditions, the sparse distribution of radar points in the Point of View (POV) poses challenges for self-supervised fusion. To address these issues, we introduce a novel self-training pipeline using unpaired real all-weather data through multi-teacher distillation and robust radar fusion. We propose the Uncertainty-Aware Multi-Teacher Distillation method to generate diverse teacher models with different adverse condition inputs, and then employ uncertainty modeling to weigh the knowledge distillation loss. Additionally, we design the POV-BEV Radar Fusion approach, which leverages camera-pixel ray constraints to establish connections between the camera's Point of View (POV) and the radar's Bird's-Eye View (BEV). This approach enables the utilization of denser radar points, effectively capturing the complementary perspectives of both POV and BEV. Extensive quantitative and qualitative experiments demonstrate the robustness of our proposed method on all-weather datasets, achieving state-of-the-art performance. Our code and models are available at https://github.com/MICLAB-BUPT/RobustDepth.
