Search papers, labs, and topics across Lattice.
This paper introduces Gaussian-Voxel Duet, a hybrid 3D representation that combines Gaussian Splatting with a sparse voxel scaffold to improve monocular surface reconstruction. By tethering Gaussians to a voxelized SDF, the method achieves better geometric accuracy and optimization efficiency compared to existing approaches. Experiments on ScanNet++ and other datasets demonstrate state-of-the-art surface reconstruction quality, superior novel view synthesis, and fast training convergence.
Achieve SOTA monocular 3D reconstruction and novel view synthesis without sacrificing speed, by fusing Gaussian Splatting with voxel-based SDFs.
While 3D Gaussian Splatting has achieved remarkable success in photorealistic novel view synthesis, its pursuit of fast and high-fidelity 3D reconstruction has long been constrained by a trade-off between geometric accuracy and optimization efficiency. Methods specialized in image rendering converge quickly at the cost of imperfect geometry caused by superfluous primitives overfitting training views, while methods integrating neural signed-distance field (SDF) for better geometry incur prohibitive training costs. In this paper, we attempt to strike a better trade-off by tethering scaffold-anchored Gaussians to a jointly optimized sparse voxel scaffold. This hybrid Gaussian-Voxel representation explicitly confines anchored Gaussians to a narrow band around surfaces defined by voxelized SDFs, which effectively improves representation efficiency and condenses floating Gaussians without sacrificing geometry quality. An implicit surface tethering loss further pulls individual Gaussian primitives closer to SDF-induced surfaces in a mutually regularized manner for improved reconstruction accuracy. Extensive experiments on diverse real-world indoor scenes from ScanNet++, ScanNetv2, and DeepBlending datasets demonstrate that our method achieves state-of-the-art surface reconstruction quality as well as superior novel view synthesis against leading baselines, while maintaining fast training convergence and real-time rendering. Code will be available at https://github.com/duzh11/VoxelGS.
