Search papers, labs, and topics across Lattice.
This work introduces a latent Consistency Model for identity-conditioned face synthesis that significantly reduces computational costs while maintaining high image quality. By distilling knowledge from the Arc2Face diffusion model and adapting its pipeline to utilize identity embeddings instead of textual prompts, the model achieves an average inference time of 0.4819 seconds per image, a 4.36脳 speed-up compared to the original model. Quantitative evaluations demonstrate that the distilled model competes well with Arc2Face across various datasets, achieving near-parity on CelebA and outperforming it on WebFace42M.
Achieving a 4.36脳 speed-up in face synthesis without sacrificing image quality could revolutionize the generation of large-scale synthetic face datasets.
Diffusion models have achieved strong results in high-fidelity image synthesis, but their iterative sampling process makes large-scale generation computationally expensive. This limitation is especially relevant when generating synthetic face datasets for face recognition, where a large number of subjects with many samples in different poses, expressions, ages, etc., are required. In this work, we show that identity-conditioned face synthesis can be performed at a substantially lower computational cost by a latent Consistency Model with few iterations, without compromising image quality. For training, we distill knowledge from the foundation Diffusion Model Arc2Face (teacher) by adapting its original text-to-image pipeline to an embedding-to-face setting, replacing textual prompts with ArcFace identity embeddings. Our distilled model (student) generates identity-conditioned face images with an average inference time of 0.4819 seconds per image, compared with 2.102 seconds for Arc2Face, resulting in a 4.36$\times$ speed-up. Quantitative results, based on FID scores, show that the distilled model remains competitive with Arc2Face across all evaluation protocols. On 100k generated images, it achieves near-parity on CelebA (13.921 vs. 12.928) and outperforms the teacher on WebFace42M (9.317 vs. 9.802). Further evaluations on Synth-500 and AgeDB show a moderate performance gap for the former but comparable results for the latter. These results indicate that Arc2Face can be accelerated through task-specific latent consistency distillation while preserving high image quality for large-scale synthetic face generation. Our proposal is publicly available at https://github.com/UFPR-IPASP-PR/FaceRec-IdentityConsistency.
