Search papers, labs, and topics across Lattice.
This paper introduces GenSplatCodec, a novel feed-forward Gaussian codec that enhances 3D scene reconstruction by integrating geometry-guided generative decoding to improve low-bitrate Gaussian compression. The method addresses the limitations of existing compression techniques by maintaining high-frequency textures and view-dependent appearances while ensuring cross-view consistency. Experimental results show that GenSplatCodec significantly outperforms existing methods in rate-distortion performance across various datasets, demonstrating its effectiveness in producing high-fidelity novel views.
Achieving superior rate-distortion performance, GenSplatCodec redefines low-bitrate Gaussian compression by seamlessly integrating geometry and appearance cues for high-fidelity 3D scene reconstruction.
Feed-forward 3D Gaussian Splatting (3DGS) enables scalable scene reconstruction without per-scene optimization, yet produces dense Gaussians that are costly to store and transmit. Existing feed-forward Gaussian compression methods formulate decoding as deterministic representation recovery, which becomes inadequate at low bitrates when high-frequency textures and view-dependent appearance are discarded. Although generative models offer a promising alternative, using them as standalone post-processing decouples generation from the transmitted scene structure, thereby compromising cross-view consistency. To address these limitations, we propose GenSplatCodec, a unified feed-forward Gaussian codec that reformulates low-bitrate Gaussian compression as geometry-guided generative decoding. We present a detail-aware feed-forward Gaussian coding scheme within a dual-stream formulation, where the resulting compact Gaussian structural stream is complemented by a lightweight reference appearance stream. We further introduce a geometry-guided one-step generative decoding approach that jointly exploits decoded structural and appearance cues through hierarchical geometry control to reconstruct high-fidelity and view-consistent novel views. Finally, we develop a three-stage optimization strategy that stabilizes the learning of the unified codec and adapts the generative decoder to codec-derived structural and appearance cues. Extensive experiments across multiple datasets demonstrate that GenSplatCodec consistently achieves superior rate-distortion (RD) performance over existing methods.
Meta AI