Search papers, labs, and topics across Lattice.
This paper introduces a Dual Range-Voxel Representation (DRVR) for LiDAR-based 3D semantic occupancy prediction, addressing the limitations of existing multi-sweep methods that suffer from inefficiencies and robustness issues. By leveraging both range-view context and voxel-view geometry from single-sweep point clouds, the DRVR enhances semantic learning and occupancy perception without the computational burden of stacking multiple sweeps. Experimental results demonstrate a significant 5.4% improvement in mean Intersection over Union (mIoU) and a 2.1x speedup over traditional multi-sweep approaches on the nuScenes-Occupancy dataset.
Single-sweep LiDAR processing can outperform multi-sweep methods, achieving 5.4% better accuracy and 2.1x faster predictions.
LiDAR-based 3D semantic occupancy prediction, which aims to provide accurate and comprehensive scene representation, is crucial for autonomous driving systems. As point clouds suffer from sparsity and incompleteness, leading to insufficient semantic learning and difficult occupancy perception, existing methods often stack multi-sweep point clouds to obtain dense spatial information. However, such a naive strategy also results in efficiency (e.g., additional computational burden) and robustness (e.g., pose transformation noise) concerns, which hinder their practical applications. In this work, we propose a Dual Range-Voxel Representation (DRVR) that leverages the range-view context and voxel-view geometry of single-sweep point clouds for 3D semantic occupancy prediction, eliminating the concerns associated with the multi-sweeps. Specifically, we use the range-view encoder to extract the compact context of the scene. To fully exploit the spatial information, we design a geometry-aware voxel-view encoder that extracts multi-scale voxel-view features separately and combines them for better geometric occupancy prediction. Moreover, we propose a range-voxel fusion module to cooperate range- and voxel-view features via voxel-to-range and range-to-voxel fusions. Extensive experiments on nuScenes-Occupancy, SemanticKITTI and SemanticPOSS show the superiority of our method. Especially on nuScenes-Occupancy, our single-sweep DRVR achieves 5.4% improvement in mIoU and 2.1x acceleration compared to the multi-sweep method.
