Search papers, labs, and topics across Lattice.
This paper introduces the Self-Adaptive Gaussian Expression (SAGE) framework, which enables the creation of high-fidelity, animatable avatars using minimal input data by optimizing 2D Gaussian surfels and a Signed Distance Field (SDF). By employing a self-supervised learning phase that leverages geometric and appearance consistency, SAGE significantly reduces the data requirements for dynamic facial expression modeling, allowing for effective avatar generation from just a single frame or even without prior training. The results indicate that SAGE achieves comparable reconstruction and animation quality to state-of-the-art methods while drastically improving data efficiency.
Achieving high-fidelity avatar animation with just a single frame, SAGE revolutionizes the data requirements for dynamic facial expression modeling.
Modeling dynamic facial expressions using 3D Gaussian representations remains challenging due to their unstructured nature. Conventional Gaussian avatar pipelines require extensive multiview and sequential expression data, limiting scalability and accessibility. In this work, we introduce Self-Adaptive Gaussian Expression (SAGE), a framework for self-learning expression-induced Gaussian deformations that enables high-fidelity, animatable avatars from minimal input data. Our method jointly optimizes 2D Gaussian surfels and a Signed Distance Field (SDF) to enforce compact, surface-aligned Gaussian distributions, while a self-supervised expression learning phase replaces long training sequences with geometric and appearance consistency constraints. This design allows flexible deployment across multiple reconstruction regimes: in the multiview setting, only a single frame (timestep) is required instead of thousands; in the monocular setting, only head rotations are needed without expression sequences; and in the one-shot setting, no pretraining or priors are necessary. Experiments demonstrate that our approach achieves reconstruction and animation quality comparable to state-of-the-art methods, while reducing data requirements by several orders of magnitude. Our results highlight the potential of self-supervised Gaussian deformation learning as a step toward accessible, data-efficient avatar creation.
