Search papers, labs, and topics across Lattice.
S-Avatar introduces a novel three-stage pipeline for generating photorealistic 3D head avatars from a single image, utilizing a diffusion-guided Gaussian splat generation module and the FLAME parametric head model. This method effectively addresses the challenge of maintaining 3D consistency across unseen viewpoints, which is critical for lifelike virtual reality applications. Evaluations show that S-Avatar significantly outperforms existing techniques in both novel-view synthesis and expression generation, enhancing realism and consistency in avatar creation.
Achieving photorealistic 3D head avatars from a single image, S-Avatar sets a new standard for realism and consistency in virtual reality applications.
We propose S-Avatar, a novel method for generating photorealistic 3D head avatars from a single image using a diffusion-guided 3D model generation module and strategies for animating 3D Gaussian Splatting (3DGS). While single-image head avatar reconstruction is crucial for lifelike Virtual Reality (VR) applications, existing approaches often struggle to preserve 3D consistency under unseen viewpoints. S-Avatar addresses this limitation through a three-stage pipeline. First, a high-resolution 3DGS is synthesized directly from a single image using a diffusion-based Gaussian splat generation module. Next, the parametric head model FLAME is aligned with the generated 3DGS by optimizing its parameters and spatial transformations. Finally, to adapt the 3DGS to FLAME variations, we construct a binding template that encodes the spatial relationship between the initial splats and FLAME. The dynamic 3D head avatar can then be rendered in real time by deforming the 3DGS with the binding template. By combining diffusion-guided canonical 3DGS generation with FLAME-based control, our method achieves efficient and accurate reconstruction with enhanced 3D consistency. Evaluations on public datasets demonstrate that S-Avatar outperforms state-of-the-art methods in novel-view and expression generation, achieving superior realism and consistency. Consequently, our approach represents a significant advance in accessible avatar creation, applicable to a wide range of VR/AR applications. The project page is available at https://github.com/hailsong/savatar.
