Search papers, labs, and topics across Lattice.
This paper introduces a hybrid Gaussian-hash-grid radiance representation, termed "Hybrid Latents," for improved 3D scene reconstruction from multi-view images. It combines per-Gaussian latent features with hash-grid features to explicitly separate low- and high-frequency scene components, mitigating the entanglement of geometry and appearance seen in NeRF-based methods. Experiments on synthetic and real-world datasets demonstrate that this approach achieves superior reconstruction fidelity with significantly fewer primitives compared to state-of-the-art Gaussian-based novel view synthesis techniques.
Decomposing scene representation into explicit frequency bands lets you reconstruct 3D scenes with an order of magnitude fewer primitives.
We introduce a hybrid Gaussian-hash-grid radiance representation for reconstructing 2D Gaussian scene models from multi-view images. Similar to NeST splatting, our approach reduces the entanglement between geometry and appearance common in NeRF-based models, but adds per-Gaussian latent features alongside hash-grid features to bias the optimizer toward a separation of low- and high-frequency scene components. This explicit frequency-based decomposition reduces the tendency of high-frequency texture to compensate for geometric errors. Encouraging Gaussians with hard opacity falloffs further strengthens the separation between geometry and appearance, improving both geometry reconstruction and rendering efficiency. Finally, probabilistic pruning combined with a sparsity-inducing BCE opacity loss allows redundant Gaussians to be turned off, yielding a minimal set of Gaussians sufficient to represent the scene. Using both synthetic and real-world datasets, we compare against the state of the art in Gaussian-based novel-view synthesis and demonstrate superior reconstruction fidelity with an order of magnitude fewer primitives.
