Search papers, labs, and topics across Lattice.
This paper introduces UniqueSplat, a novel view-conditioned feed-forward 3D Gaussian Splatting model that reconstructs tailored 3D radiance fields for specific view queries. Unlike previous methods that utilize fixed Gaussians across all views, UniqueSplat dynamically adjusts Gaussian parameters based on the target view, leveraging a two-branch hyperNetwork to learn both view-agnostic embeddings and view-specific information. Experimental results on benchmark datasets, including RealEstate10K, ACID, and DTU, demonstrate that UniqueSplat not only surpasses state-of-the-art methods but also exhibits strong generalization capabilities across different datasets.
UniqueSplat adapts Gaussian representations to specific viewpoints, achieving superior 3D reconstruction and generalization across datasets.
In this paper, we propose UniqueSplat, a view-conditioned feed-forward 3D Gaussian Splatting model to reconstruct customized 3D radiance fields for each view query. Existing feed-forward methods such as pixelSplat and MVSplat aim to generate fixed Gaussians across all views of each scene by minimizing the error between rendered views and ground-truth images. However, such fixed Gaussians generally render images from all views and lack the ability to adapt to specific viewpoints, as they do not incorporate target view information when predicting Gaussians. To address this, our UniqueSplat learns the view-conditioned information as a prior and incorporates this knowledge into network parameters, so that Gaussians are dynamically adjusted in accordance with different views. Specifically, we propose a two-branch view-conditioned hyperNetwork to simultaneously learn view-agnostic embeddings and view-specific knowledge, which not only explores the shareable knowledge from various views, but also adapts the model to specific views at test time. Extensive experiments on widely-used datasets including RealEstate10K, ACID and DTU demonstrate the superiority of UniqueSplat over the state-of-the-art methods. Moreover, UniqueSplat encouragingly outperforms existing methods in cross-dataset evaluation, showing its notable generalization ability.
Tsinghua AI