Search papers, labs, and topics across Lattice.
The paper introduces Fore-Mamba3D, a novel Mamba-based backbone for 3D object detection that focuses on foreground enhancement by encoding only foreground voxels. To combat response attenuation and restricted context representation when encoding foreground-only sequences, they propose a regional-to-global slide window (RGSW) to propagate information and a semantic-assisted state spatial fusion module (SASFMamba) to enrich contextual representation. Experiments demonstrate that Fore-Mamba3D achieves superior performance on various 3D object detection benchmarks by emphasizing foreground encoding and alleviating dependencies in linear autoregressive models.
By focusing Mamba's attention on foreground voxels, Fore-Mamba3D achieves superior 3D object detection performance, overcoming limitations of previous Mamba-based methods that process the entire voxel sequence.
Linear modeling methods like Mamba have been merged as the effective backbone for the 3D object detection task. However, previous Mamba-based methods utilize the bidirectional encoding for the whole non-empty voxel sequence, which contains abundant useless background information in the scenes. Though directly encoding foreground voxels appears to be a plausible solution, it tends to degrade detection performance. We attribute this to the response attenuation and restricted context representation in the linear modeling for fore-only sequences. To address this problem, we propose a novel backbone, termed Fore-Mamba3D, to focus on the foreground enhancement by modifying Mamba-based encoder. The foreground voxels are first sampled according to the predicted scores. Considering the response attenuation existing in the interaction of foreground voxels across different instances, we design a regional-to-global slide window (RGSW) to propagate the information from regional split to the entire sequence. Furthermore, a semantic-assisted and state spatial fusion module (SASFMamba) is proposed to enrich contextual representation by enhancing semantic and geometric awareness within the Mamba model. Our method emphasizes foreground-only encoding and alleviates the distance-based and causal dependencies in the linear autoregression model. The superior performance across various benchmarks demonstrates the effectiveness of Fore-Mamba3D in the 3D object detection task.
