Search papers, labs, and topics across Lattice.
This paper introduces ConFusion, a camera-radar fusion architecture for 3D object detection that leverages heterogeneous query interaction to improve object coverage and cross-modal reasoning. The core innovation lies in the introduction of heterogeneous query mixing (QMix) and interactive query swap sampling (QSwap), which facilitate dedicated cross-type attention and feature exchange among image, radar, and world queries. Experiments on the nuScenes dataset demonstrate state-of-the-art performance, achieving 61.6 mAP and 67.9 NDS on the test set, indicating the effectiveness of the proposed fusion paradigm.
Camera-radar fusion gets a boost: ConFusion's heterogeneous query interaction surpasses existing methods, achieving state-of-the-art 3D object detection performance on nuScenes.
In autonomous driving, camera-radar fusion offers complementary sensing and low deployment cost. Existing methods perform fusion through input mixing, feature map mixing, or query-based feature sampling. We propose a new fusion paradigm, termed heterogeneous query interaction, and present ConFusion, a camera-radar 3D object detector. ConFusion combines image queries, radar queries, and learnable world queries distributed in 3D space to improve query initialization and object coverage. To encourage cross-type interaction among heterogeneous queries, we introduce heterogeneous query mixing (QMix), which performs dedicated cross-type attention after feature sampling to consolidate complementary object evidence. We further propose interactive query swap sampling (QSwap), which improves feature sampling by allowing related queries to exchange informative feature tokens under attention and geometric constraints. Experiments on the nuScenes dataset show that ConFusion achieves state-of-the-art performance, reaching 59.1 mAP and 65.6 NDS on the validation set, and 61.6 mAP and 67.9 NDS on the test set.
