Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces Cross-Task Attention Bridge (CTAB), a bidirectional module leveraging multi-scale deformable attention in BEV space to facilitate feature exchange between 3D object detection and segmentation tasks. By sharing object-level geometry from detection to sharpen segmentation and dense semantic context from segmentation to anchor detection, CTAB enhances multi-task learning. Experiments on nuScenes demonstrate that CTAB improves segmentation performance without sacrificing detection accuracy, achieving comparable segmentation mIoU while simultaneously enabling 3D detection.
Trading features between 3D detection and segmentation in BEV space lets you boost segmentation accuracy without hurting detection.
Bird's-eye-view (BEV) representations are the dominant paradigm for 3D perception in autonomous driving, providing a unified spatial canvas where detection and segmentation features are geometrically registered to the same physical coordinate system. However, existing radar-camera fusion methods treat these tasks in isolation, missing the opportunity to share complementary information between them: detection features encode object-level geometry that can sharpen segmentation boundaries, while segmentation features provide dense semantic context that can anchor detection. We propose \textbf{CTAB} (Cross-Task Attention Bridge), a bidirectional module that exchanges features between detection and segmentation branches via multi-scale deformable attention in shared BEV space. CTAB is integrated into a multi-task framework with an Instance Normalization-based segmentation decoder and learnable BEV upsampling to provide a more detailed BEV representation. On nuScenes, CTAB improves segmentation on 7 classes over the joint multi-task baseline at essentially neutral detection. On a 4-class subset (drivable area, pedestrian crossing, walkway, vehicle), our joint multi-task model reaches comparable mIoU on 4 classes while simultaneously providing 3D detection.