Search papers, labs, and topics across Lattice.
This paper introduces BEV-Denoise, a framework that effectively estimates and removes intrinsic noise from Bird's-Eye-View (BEV) features to enhance semantic segmentation accuracy. By leveraging Denoising Diffusion Probabilistic Models (DDPM) and a UNet-based noise estimation module, the authors implement a Task Decomposition learning paradigm to train a view transformation encoder, significantly improving the quality of BEV map predictions. Experimental results on the nuScenes dataset reveal that BEV-Denoise outperforms existing models across various view transformation paradigms, highlighting its practical applicability in real-world scenarios.
Removing intrinsic noise from BEV features can lead to a significant boost in semantic segmentation accuracy, as shown by our results on the nuScenes dataset.
In this paper, we present a framework dubbed \textbf{BEV-Denoise} that estimates and removes intrinsic noise from learned Bird's-Eye-View (BEV) features to achieve accurate BEV semantic segmentation. Inspired by the noise estimation capability of Denoising Diffusion Probabilistic Models (DDPM), we design a UNet-based noise estimation module that learns to estimate the noise from the learned BEV features. The estimated noise is then subtracted from the BEV features and fed to BEV map decoders for the final prediction results. To facilitate supervision for the noise estimation module, we follow a sequential learning paradigm called Task Decomposition (TD) where a pre-trained BEV map autoencoder is employed to train a view transformation (VT) encoder. We share three key insights learned from our intensive experiments that are critical for improved performance. We apply our framework to four existing models, encompassing the three major VT paradigms. Experimental results on a large-scale real-world dataset, nuScenes, demonstrate the effectiveness of our framework.
