Search papers, labs, and topics across Lattice.
The paper introduces R3GW, a novel method extending 3D Gaussian Splatting (3DGS) to handle relighting and reconstruction of outdoor scenes captured under varying illumination conditions. R3GW separates the scene into relightable foreground and non-reflective background (sky) using distinct Gaussian sets, and models view-dependent lighting effects in the foreground using physically based rendering integrated with the 3DGS representation. Experiments on the NeRF-OSR dataset demonstrate state-of-the-art performance in novel view synthesis and physically-based relighting, while also improving sky-foreground boundary rendering.
Finally, you can relight 3D Gaussian splats of outdoor scenes captured in the wild, opening the door to realistic scene manipulation and editing.
3D Gaussian Splatting (3DGS) has established itself as a leading technique for 3D reconstruction and novel view synthesis of static scenes, achieving outstanding rendering quality and fast training. However, the method does not explicitly model the scene illumination, making it unsuitable for relighting tasks. Furthermore, 3DGS struggles to reconstruct scenes captured in the wild by unconstrained photo collections featuring changing lighting conditions. In this paper, we present R3GW, a novel method that learns a relightable 3DGS representation of an outdoor scene captured in the wild. Our approach separates the scene into a relightable foreground and a non-reflective background (the sky), using two distinct sets of Gaussians. R3GW models view-dependent lighting effects in the foreground reflections by combining Physically Based Rendering with the 3DGS scene representation in a varying illumination setting. We evaluate our method quantitatively and qualitatively on the NeRF-OSR dataset, offering state-of-the-art performance and enhanced support for physically-based relighting of unconstrained scenes. Our method synthesizes photorealistic novel views under arbitrary illumination conditions. Additionally, our representation of the sky mitigates depth reconstruction artifacts, improving rendering quality at the sky-foreground boundary
