Search papers, labs, and topics across Lattice.
This paper addresses the limitations of traditional spherical harmonics (SH) in view-dependent appearance modeling for novel-view synthesis by systematically evaluating a variety of spherical functions. The authors introduce the Normalized Anisotropic Spherical Gabor function, which allows for efficient modeling of high-frequency appearance effects while significantly reducing memory usage and computational costs. Their method achieves superior reconstruction quality for complex phenomena like specular reflections, outperforming existing techniques by being up to five times more memory-efficient.
High-frequency appearance effects can be captured with a novel spherical function that is five times more memory-efficient than traditional methods.
View-dependent appearance modeling remains a challenging problem in novel-view synthesis and reconstruction. Accurately representing complex angular effects often requires substantial memory and computational resources. For new learning-based methods, a common approach is to rely on SH. However, capturing high-frequency phenomena such as specular reflections demands high-order expansions, which increase memory usage and computational cost. Consequently, most methods employ low-order SH, which limits the ability to model complex view-dependent effects, resulting in overly smooth or diffuse representations. To address these limitations, we systematically evaluate a wide range of spherical functions in the context of scene reconstruction. Some of them are introduced to graphics and computer vision for the first time in this paper. Based on the insights from the experiment, we develop a novel spherical formulation, the Normalized Anisotropic Spherical Gabor function that enables efficient modeling and learning of high-frequency appearance effects while maintaining compact representation. Compared to existing approaches, our function achieves higher-quality reconstruction of view-dependent phenomena such as glints, while being up to five times more memory-efficient and more efficient to evaluate. We validate its performance in radiance-field reconstruction tasks.
