Search papers, labs, and topics across Lattice.
This paper addresses the challenge of 3D scene reconstruction from unposed sparse viewpoints by introducing a novel framework that combines bidirectional pseudo frame restoration with scene perception Gaussian management. The bidirectional restoration uses diffusion models guided by adjacent frames and a pseudo-view deblur model, along with confidence masks, to synthesize missing content. The Gaussian management strategy optimizes Gaussians using joint depth-density information, leading to improved reconstruction quality, especially in outdoor scenes.
Diffusion models can generate plausible intermediate views to boost sparse-view 3D reconstruction, but only if you carefully control their geometry with confidence-weighted fusion and manage the resulting Gaussians.
3D scene reconstruction under unposed sparse viewpoints is a highly challenging yet practically important problem, especially in outdoor scenes due to complex lighting and scale variation. With extremely limited input views, directly utilizing diffusion model to synthesize pseudo frames will introduce unreasonable geometry, which will harm the final reconstruction quality. To address these issues, we propose a novel framework for sparse-view outdoor reconstruction that achieves high-quality results through bidirectional pseudo frame restoration and scene perception Gaussian management. Specifically, we introduce a bidirectional pseudo frame restoration method that restores missing content by diffusion-based synthesis guided by adjacent frames with a lightweight pseudo-view deblur model and confidence mask inference algorithm. Then we propose a scene perception Gaussian management strategy that optimize Gaussians based on joint depth-density information. These designs significantly enhance reconstruction completeness, suppress floating artifacts and improve overall geometric consistency under extreme view sparsity. Experiments on outdoor benchmarks demonstrate substantial gains over existing methods in both fidelity and stability.
