Search papers, labs, and topics across Lattice.
The paper introduces an augmented radiance field representation based on 3D Gaussian Splatting (3DGS) to improve the modeling of specular reflections. They address the limitations of spherical harmonics in 3DGS by introducing a novel Gaussian kernel with view-dependent opacity to explicitly model specular effects. The method uses 2D Gaussian initialization followed by adaptive insertion and optimization of these enhanced Gaussian kernels, resulting in improved rendering performance and parameter efficiency compared to NeRF-based methods.
By explicitly modeling specular effects with view-dependent opacity, this augmented Gaussian Splatting method leapfrogs NeRFs in rendering performance and parameter efficiency.
Due to the real-time rendering performance, 3D Gaussian Splatting (3DGS) has emerged as the leading method for radiance field reconstruction. However, its reliance on spherical harmonics for color encoding inherently limits its ability to separate diffuse and specular components, making it challenging to accurately represent complex reflections. To address this, we propose a novel enhanced Gaussian kernel that explicitly models specular effects through view-dependent opacity. Meanwhile, we introduce an error-driven compensation strategy to improve rendering quality in existing 3DGS scenes. Our method begins with 2D Gaussian initialization and then adaptively inserts and optimizes enhanced Gaussian kernels, ultimately producing an augmented radiance field. Experiments demonstrate that our method not only surpasses state-of-the-art NeRF methods in rendering performance but also achieves greater parameter efficiency. Project page at: https://xiaoxinyyx.github.io/augs.
