Search papers, labs, and topics across Lattice.
This paper introduces a novel framework for reconstructing high-quality 3D scenes from a single Snapshot Compressive Imaging (SCI) measurement by integrating 3D Gaussian Splatting (3DGS) with large-scale vision foundation models (VFMs). The approach addresses challenges such as information loss and viewpoint diversity by employing a two-stage optimization process that includes SCI-aware Gaussian optimization and pseudo-view supervision for local refinement. Experimental results show that this method outperforms existing techniques in reconstruction quality and robustness while maintaining competitive computational efficiency.
Achieving superior 3D scene reconstruction from a single measurement, this method combines Gaussian Splatting with advanced vision model priors to tackle the complexities of Snapshot Compressive Imaging.
Snapshot Compressive Imaging (SCI) offers an efficient solution for high-speed video acquisition and, under exposure-time camera--scene relative motion, multi-view scene capture by compressing temporal or spatial information into a single 2D measurement. While recent studies have explored SCI for 3D scene reconstruction, existing methods struggle with significant challenges due to information loss, limited viewpoint diversity, and the computational burden of jointly optimizing 3D representations and camera poses. In this work, we propose a novel framework that reconstructs high-quality 3D scenes from a single SCI measurement by leveraging 3D Gaussian Splatting (3DGS) and the powerful priors of large-scale vision foundation models (VFMs). Our primary reconstruction combines measurement-derived 3D VFM initialization with SCI-aware Gaussian optimization. After coarse-stage convergence, an auxiliary 2D VFM provides pseudo-view supervision at synthesized viewpoints for local appearance refinement. To further address the instability caused by ambiguous SCI supervision during 3DGS optimization, we introduce Opacity-Guided Splitting and Growth Regulation (OSGR), an SCI-specific densification strategy that augments split candidates using local opacity statistics, discourages loss-compensating opacity inflation through mean-opacity regulation, and bounds representation growth with explicit candidate-ratio and Gaussian-count constraints. Extensive experiments across multiple benchmarks demonstrate that our method achieves the strongest overall performance, combining leading reconstruction quality and robustness to viewpoint variation with competitive computational efficiency.
