Search papers, labs, and topics across Lattice.
The paper introduces Appearance Decomposition Gaussian Splatting (ADM-GS), a novel framework for multi-traversal scene reconstruction that addresses appearance inconsistencies caused by varying illumination and environmental conditions. ADM-GS decomposes the appearance of the static background into traversal-invariant material and traversal-dependent illumination using a neural light field with frequency-separated hybrid encoding. Experiments on Argoverse 2 and Waymo Open datasets demonstrate that ADM-GS achieves a +0.98 dB PSNR improvement over existing latent-based baselines and generates more consistent appearance across traversals.
Achieve photorealistic multi-traversal 3D reconstruction by disentangling illumination from material properties, even when the same scene is captured under drastically different lighting conditions.
Multi-traversal scene reconstruction is important for high-fidelity autonomous driving simulation and digital twin construction. This task involves integrating multiple sequences captured from the same geographical area at different times. In this context, a primary challenge is the significant appearance inconsistency across traversals caused by varying illumination and environmental conditions, despite the shared underlying geometry. This paper presents ADM-GS (Appearance Decomposition Gaussian Splatting for Multi-Traversal Reconstruction), a framework that applies an explicit appearance decomposition to the static background to alleviate appearance entanglement across traversals. For the static background, we decompose the appearance into traversal-invariant material, representing intrinsic material properties, and traversal-dependent illumination, capturing lighting variations. Specifically, we propose a neural light field that utilizes a frequency-separated hybrid encoding strategy. By incorporating surface normals and explicit reflection vectors, this design separately captures low-frequency diffuse illumination and high-frequency specular reflections. Quantitative evaluations on the Argoverse 2 and Waymo Open datasets demonstrate the effectiveness of ADM-GS. In multi-traversal experiments, our method achieves a +0.98 dB PSNR improvement over existing latent-based baselines while producing more consistent appearance across traversals. Code will be available at https://github.com/IRMVLab/ADM-GS.
