Search papers, labs, and topics across Lattice.
FFAvatar introduces a Transformer-based framework for reconstructing high-quality 4D head avatars from sparse portrait images, allowing for incremental reconstruction as more images are provided. The method employs an alternating attention mechanism to effectively separate identity appearance from expression and viewpoint variations, ensuring a consistent 3D representation across different poses. Extensive experiments show that FFAvatar achieves high fidelity and controllability, outperforming existing methods in flexibility and rendering consistency.
FFAvatar can reconstruct dynamic, identity-consistent 4D head avatars from just a few images, revolutionizing avatar creation for virtual environments.
We present FFAvatar, a Transformer-based 3D Gaussian framework for fast construction of high-quality and animatable 4D head avatars from one or more reference portrait images. Unlike existing feed-forward approaches that require a fixed number of input views, FFAvatar supports incremental reconstruction, progressively refining the avatar representation as additional reference images become available. At the core of our method is an alternating attention mechanism that disentangles identity appearance from expression and viewpoint variations, enabling the reconstruction of a canonical 3D appearance that remains consistent across poses and facial expressions. To balance visual fidelity and computational efficiency, we introduce a sparse-to-dense learning paradigm. Coarse appearance features are first learned using sparse primitives anchored to the FLAME vertex level and are subsequently densified in the UV domain to capture fine-grained geometric and texture details. We further propose a plug-and-play motion refinement module that enables subject-specific dynamic personalization by modeling residual motion beyond parametric deformation. Extensive experiments demonstrate that FFAvatar efficiently produces high-fidelity and controllable 4D head avatars, achieving superior flexibility, driving efficiency, and identity-consistent rendering across diverse expressions and viewpoints.
