Search papers, labs, and topics across Lattice.
DinoRADE, a radar-centered object detection pipeline, fuses dense radar tensors with DINOv3 vision features using deformable cross-attention to improve detection performance, especially for vulnerable road users (VRUs). By aggregating vision features around transformed radar reference points, DinoRADE overcomes limitations of radar-only approaches in resolving fine-grained spatial details. Evaluated on the K-Radar dataset, DinoRADE achieves state-of-the-art multi-class detection performance in adverse weather, outperforming existing radar-camera fusion methods by 12.1%.
Radar-camera fusion gets a 12% boost in adverse weather object detection by warping DINOv3 vision features into the radar perspective.
Reliable and weather-robust perception systems are essential for safe autonomous driving and typically employ multi-modal sensor configurations to achieve comprehensive environmental awareness. While recent automotive FMCW Radar-based approaches achieved remarkable performance on detection tasks in adverse weather conditions, they exhibited limitations in resolving fine-grained spatial details particularly critical for detecting smaller and vulnerable road users (VRUs). Furthermore, existing research has not adequately addressed VRU detection in adverse weather datasets such as K-Radar. We present DinoRADE, a Radar-centered detection pipeline that processes dense Radar tensors and aggregates vision features around transformed reference points in the camera perspective via deformable cross-attention. Vision features are provided by a DINOv3 Vision Foundation Model. We present a comprehensive performance evaluation on the K-Radar dataset in all weather conditions and are among the first to report detection performance individually for five object classes. Additionally, we compare our method with existing single-class detection approaches and outperform recent Radar-camera approaches by 12.1%. The code is available under https://github.com/chr-is-tof/RADE-Net.