Search papers, labs, and topics across Lattice.
This paper introduces SeeU, a novel framework for Generalizable 3D Gaussian Splatting (G-3DGS) that addresses the limitations of existing methods in rendering partially observed or occluded regions. By employing a Semantic-in-Gaussian approach, it integrates a Cross-view Entropy-Aware (CEA) module to refine Gaussian estimations using multi-view semantic and geometric information. Experimental results show that SeeU significantly enhances rendering quality and structural completeness, achieving an average PSNR improvement of 2.44 dB over state-of-the-art methods in challenging extrapolation scenarios.
SeeU redefines 3D rendering by leveraging semantic cues to recover hidden structures, achieving unprecedented quality in sparse-view settings.
Generalizable 3D Gaussian Splatting (G-3DGS) has emerged as a promising approach for novel view synthesis undersparse-view settings. However, existing frameworks remain restricted by pixel-aligned Gaussian estimation, whichstruggles in partially observed or occluded regions and often leads to incomplete surfaces or structural collapse. Toaddress these challenges, we propose SeeU (Seeing the Unseen), a novel G-3DGS framework. We frame its core design asSemantic-in-Gaussian: semantic-conditioned refinement in Gaussian space. Specifically, we introduce a Cross-viewEntropy-Aware (CEA) module that aggregates multi-view semantic and geometric cues into compact embeddings. Theseembeddings guide the Conditional Gaussian Transformer, which applies residual updates to coarse Gaussians, helpingrecover under-constrained regions of partially observed structures while preserving surface consistency. Comprehensiveexperiments on multiple benchmarks demonstrate that SeeU consistently improves rendering quality and structuralcompleteness while retaining efficient feed-forward inference. Especially under challenging extrapolation settings,SeeU achieves an average improvement of 2.44 dB in PSNR compared to recent SOTA G-3DGS methods.
