Search papers, labs, and topics across Lattice.
DeeperRadar introduces a radar-centric framework that integrates multi-modal 3D detection for autonomous vehicles by co-designing radar sensing with a learnable MIMO design module. This module is trained end-to-end using raw radar data alongside camera and LiDAR inputs, allowing the system to optimize the number of active receiver antennas based on the task at hand. Evaluations on the RADIal dataset reveal that DeeperRadar achieves comparable or superior performance to full-array configurations while significantly reducing the number of receivers needed, thereby lowering costs and complexity in radar integration.
Sparse, task-aware radar configurations can outperform traditional full-array setups, revolutionizing radar design for autonomous vehicles.
DeeperRadar is a radar-centric, sensor-stack-conditioned framework that co-designs radar sensing and multi-modal 3D detection for autonomous mobility by learning a sparse acquisition pattern end-to-end with the fusion model. A learnable MIMO design module is trained end-to-end within a fusion network that operates directly on raw radar ADC data together with camera images and LiDAR point clouds. During training, the design module is supervised by the other sensors, enabling the system to learn both which receiver antennas to activate and the effective number of them. At deployment, the design module is removed and replaced by the learned sparse subsampling mask, leaving the downstream model architecture unchanged. Evaluated on the RADIal dataset, DeeperRadar discovers sparse, task-aware radar configurations that match or exceed full-array baselines while using fewer receivers, potentially reducing radar cost and integration complexity. These results show that learned optimal MIMO radar design depends on the fusion stack and the downstream perception task.
