Search papers, labs, and topics across Lattice.
This paper introduces a novel differentiable point rendering method utilizing opacity-bearing beta surfels for sparse view 3D reconstruction under known illumination. By incorporating an explicit adjoint light transport formulation, the method optimally constrains the reconstruction of geometry and appearance parameters, leading to significant improvements in accuracy. The proposed approach achieves a 28.5% reduction in mean Chamfer distance compared to the strongest baseline while using significantly fewer surfels, demonstrating its efficiency and effectiveness in reconstructing 3D surfaces.
Achieving 28.5% better accuracy with 161 fewer primitives, this method revolutionizes sparse view 3D reconstruction efficiency.
Sparse view 3D reconstruction is commonly addressed with neural implicit surfaces or dense point-based representations such as Gaussian splatting. Surface-aware splatting methods improve extracted geometry through oriented primitives and regularization, while RadiosityGS incorporates differentiable light transport through a radiosity inspired finite-element surfel formulation. We propose a differentiable point rendering method based on opacity-bearing beta surfels. An opacity explicit adjoint light transport formulation provides gradients for surfel geometry and appearance parameters, allowing physically based light transport to constrain reconstruction. Across five synthetic objects reconstructed from ten posed views, our method achieves the lowest mean symmetric Chamfer distance among the evaluated baselines and reduces mean Chamfer distance by 28.5% relative to the strongest point-based baseline while using only 267 surfels on average, approximately ~161 fewer primitives. Directional Chamfer results further show improved accuracy and competitive completion relative to related point-based methods. These results show that, in the controlled direct illumination setting, compact beta surfels combined with transport-based optimization can recover surfaces without relying on the tens to hundreds of thousands of primitives used by the evaluated baselines.
