Search papers, labs, and topics across Lattice.
AptAvatar is a 14B-parameter framework designed for efficient long-form audio-driven avatar generation, achieving rapid inference without sacrificing visual fidelity or motion expressiveness. By introducing Endpoint-Anchored Distribution Distillation and Self-Generated History Replay, the model effectively bridges the gap between multi-step teacher models and two-step student models, ensuring high-quality outputs even in production settings. Extensive experiments show that AptAvatar can generate vivid 720p videos with a 60x speedup while maintaining long-horizon consistency and identity.
Achieving a 60x speedup in avatar generation without compromising visual quality could revolutionize production workflows in multimedia content creation.
Production-ready audio-driven avatar generation requires efficient inference without sacrificing fidelity or motion expressiveness. However, existing acceleration methods often compromise quality through restrictive architectural choices, such as causal attention and short temporal horizons, or by reducing model capacity and resolution. Without such compromises, we propose AptAvatar, a 14B-parameter long-form audio-driven avatar generation framework that delivers fast and expressive inference. For efficiency in production-level applications, AptAvatar addresses the extreme two-step generation challenge. To bridge the gap between the multi-step teacher model and the two-step student model, we introduce Endpoint-Anchored Distribution Distillation. It augments vanilla distribution matching with a dedicated Anchor Score Estimator trained on the trajectory-endpoint distribution defined from a frozen pretrained 4-step bridge generator. This provides an attainable endpoint-level anchor for the evolving two-step student. To improve long-horizon consistency, we further introduce Self-Generated History Replay, which reuses cached outputs from earlier generator checkpoints as history conditions during chunk-wise training. This approximates inference-time conditioning on self-generated histories without costly online rollouts, mitigating quality degradation from accumulated history errors. Extensive experiments demonstrate that AptAvatar generates vivid 720p long-form avatar videos with only 2 NFEs, achieving a 60x speedup while preserving visual fidelity and long-horizon identity. Code is available at https://github.com/TaoLiveAIGC/AptAvatar