Search papers, labs, and topics across Lattice.
This paper introduces Wild3R, a novel feed-forward approach for 3D Gaussian Splatting that eliminates the need for per-scene optimization by leveraging a new dataset, WildCity, which includes 200 scenes and 170 lighting conditions. The method addresses the challenges posed by diverse lighting and transient objects in real-world photo collections, enabling the model to learn robust scene representations. Experimental results show that Wild3R significantly outperforms existing feed-forward methods and rivals traditional optimization-based techniques in performance.
Wild3R achieves competitive performance against traditional optimization methods while eliminating the need for time-consuming scene-specific adjustments.
Feed-forward 3D Gaussian Splatting (3DGS) removes the need for time-consuming per-scene optimization required by traditional 3DGS. However, existing feed-forward approaches struggle with real-world photo collections that include diverse lighting conditions and transient objects. In this paper, we present Wild3R, a feed-forward approach for unconstrained sparse photo collections. The main bottleneck is the lack of training data that provides multiple viewpoints, a variety of illuminations, and transient variations necessary for learning robust scene representations. To address this, we introduce the WildCity dataset, which comprises 200 scenes, 170 lighting conditions, and transient objects, resulting in 337,500 images in total. By leveraging the dataset, our model learns appearance consistency across viewpoints conditioned on reference views, while removing transient content. Extensive experiments demonstrate that our method outperforms existing feed-forward approaches and achieves results competitive with prior per-scene optimization-based methods.
