Search papers, labs, and topics across Lattice.
This paper introduces PCM-NeRF, a probabilistic framework for neural surface reconstruction that addresses the limitations of fixed camera poses by incorporating learnable uncertainty in pose estimates. By representing each camera pose as a distribution with a mean and variance, the method effectively adjusts the learning rate based on pose confidence, allowing for more robust reconstructions in the presence of pose inaccuracies. Experimental results show that PCM-NeRF significantly outperforms state-of-the-art techniques in challenging scenarios, particularly in terms of Chamfer Distance and F-Score, while maintaining a lightweight implementation with minimal overhead.
Uncertainty in camera poses can be learned and leveraged to dramatically improve neural surface reconstructions, especially in complex scenes.
Neural surface reconstruction methods typically treat camera poses as fixed values, assuming perfect accuracy from Structure-from-Motion (SfM) systems. This assumption breaks down with imperfect pose estimates, leading to distorted or incomplete reconstructions. We present PCM-NeRF, a probabilistic framework that augments neural surface reconstruction with per-camera learnable uncertainty, built on top of SG-NeRF. Rather than treating all cameras equally throughout optimization, we represent each pose as a distribution with a learnable mean and variance, initialized from SfM correspondence quality. An uncertainty regularization loss couples the learned variance to view confidence, and the resulting uncertainty directly modulates the effective pose learning rate: uncertain cameras receive damped gradient updates, preventing poorly initialized views from corrupting the reconstruction. This lightweight mechanism requires no changes to the rendering pipeline and adds negligible overhead. Experiments on challenging scenes with severe pose outliers demonstrate that PCM-NeRF consistently outperforms state-of-the-art methods in both Chamfer Distance and F-Score, particularly for geometrically complex structures, without requiring foreground masks.
