Search papers, labs, and topics across Lattice.
This study introduces a knowledge distillation framework that effectively transfers object-level voxel representations from a complex teacher model to lightweight student models, addressing the challenge of computational efficiency in 3D object detection for LiDAR sensors. By utilizing a multi-branch Mamba teacher backbone and a box-aware feature transfer mechanism, the proposed method aligns voxel features between networks, enabling significant reductions in computational load without sacrificing accuracy. Experimental results demonstrate that this approach outperforms existing state-of-the-art methods, making it suitable for resource-constrained embedded devices in autonomous driving and robotic navigation applications.
Achieving competitive accuracy while slashing computational costs, this method redefines the feasibility of 3D object detection on lightweight devices.
3D object detection using light detection and ranging (LiDAR) sensors requires a balance between accuracy and computational efficiency for onboard perception in autonomous driving and robotic navigation. Many existing LiDAR-based detection methods employ complex architectures to extract features, integrating large amounts of contextual information to enhance accuracy. This often results in significant computational costs, leading to suboptimal performance on resource-constrained embedded devices. In this study, we propose a knowledge distillation framework that transfers object-level voxel representations from a strong teacher model to lightweight student models through selective voxel-space feature alignment. Taking advantage of the linear-time sequence model with selective state spaces (Mamba), we design a multi-branch Mamba teacher backbone and a box-aware feature transfer mechanism that aligns spatially corresponding voxel features between teacher and student networks through a Mamba-based projection module. Experimental results on both a public dataset and real-world data show that our approach significantly reduces computational load while maintaining competitive accuracy compared with state-of-the-art methods.