Search papers, labs, and topics across Lattice.
This paper introduces VisDom, a novel geometric constraint that enhances sparse novel view synthesis (NVS) by enforcing a minimum multi-view visibility requirement, addressing the limitations of existing methods like NeRF and Gaussian Splatting that struggle with sparse input data. By defining a visible domain based on the number of views observing a 3D space, VisDom provides a stronger spatial prior, reducing artifacts and improving geometric consistency in reconstructions. Experimental results demonstrate that VisDom significantly enhances object-centric reconstruction quality from as few as four images, while being domain-agnostic and requiring no learned parameters, thus offering a cost-effective solution for NVS challenges.
Enforcing a minimum multi-view visibility requirement can drastically improve sparse novel view synthesis, achieving high-quality reconstructions with just four input images.
Sparse novel view synthesis (NVS) remains challenging due to the ambiguity of recovering 3D geometry from few input views. While NeRF- and Gaussian Splatting (GS)-based methods perform well with dense supervision, they often overfit in sparse settings, producing floating artifacts and inconsistent geometry. Silhouette consistency is commonly used as a regularizer, but it remains insufficient, as silhouette-consistent regions can extend beyond the true object geometry. We introduce VisDom, a learning-free geometric constraint that augments classical carving-based visual hull reconstruction by enforcing a minimum multi-view visibility requirement. Specifically, we define a visible domain as the subset of 3D space observed by at least $K$ views and use it as an additional filtering criterion on top of standard silhouette-based reconstruction. This provides a stronger spatial prior in sparse-view settings. We integrate VisDom into both implicit (NeRF) and explicit (GS) pipelines by restricting volumetric sampling and guiding Gaussian placement during optimization. Experiments on three challenging datasets show consistent improvements in sparse-view NVS, enabling high-quality object-centric reconstruction from as few as four input images. Our method is domain-agnostic, requires only silhouettes, and introduces no learned parameters, making it a simple complement to existing approaches. Applying VisDom on top of GaussianObject further improves performance on Omni3D and MipNeRF360, while matching or surpassing it at 22 $\times$ lower training cost.
