Search papers, labs, and topics across Lattice.
RegHead introduces a novel framework for creating semantic blendshape sets for animatable non-humanoid head avatars, addressing the challenges of scarce expression-consistent supervision and the lack of correspondence in generated 4D assets. By leveraging a large-scale dataset of non-humanoid identities and a fast feed-forward registration model, the framework enables efficient conversion of unregistered expression meshes into a high-fidelity blendshape basis. Experiments demonstrate that RegHead achieves superior expression fidelity and real-time retargeting capabilities compared to existing methods, significantly enhancing the animation of non-humanoid characters.
Achieving real-time retargeting of human facial motions to non-humanoid avatars, RegHead sets a new standard for animation fidelity and efficiency.
We present RegHead, a framework for constructing semantic blendshape sets for animatable non-humanoid head avatars. With a fixed expression vocabulary, semantic blendshapes provide a low-dimensional and interpretable animation interface and support cross-identity retargeting. Building such blendshape sets remains expensive because (i) expression-consistent supervision is scarce, (ii) generated 4D assets typically lack correspondence, and (iii) facial motion is highly localized. We propose (1) a large-scale dataset of non-humanoid identities paired with a shared expression vocabulary, obtained by expanding a small artist-rigged library via fine-tuned image editing; (2) a dense stochastic anchor motion representation tailored to localized facial deformations; and (3) a fast feed-forward registration model that converts unregistered expression meshes into a corresponded blendshape basis by predicting anchor-based deformations from the neutral shape. Experiments show that our approach produces higher-fidelity expression meshes than baselines, while running orders of magnitude faster than optimization. We further demonstrate real-time retargeting from human face tracking signals to non-humanoid characters, capturing both head pose and localized facial motions. Our project page is available at https://snap-research.github.io/RegHead/.
