Search papers, labs, and topics across Lattice.
This paper introduces Layer-Based Facial Template Inversion (LBFTI), a novel method for reconstructing high-fidelity face images from facial templates while preserving identity. LBFTI decomposes face images into foreground, midground, and background layers, using dedicated generators trained in a three-stage process involving independent layer generation, fusion with template injection, and joint fine-tuning. Experiments show LBFTI significantly improves machine authentication performance (25.3% TAR improvement) and human perceived similarity compared to state-of-the-art inversion techniques.
Reconstructing faces from templates just got a whole lot more realistic, raising the stakes for privacy in face recognition systems.
In face recognition systems, facial templates are widely adopted for identity authentication due to their compliance with the data minimization principle. However, facial template inversion technologies have posed a severe privacy leakage risk by enabling face reconstruction from templates. This paper proposes a Layer-Based Facial Template Inversion (LBFTI) method to reconstruct identity-preserving fine-grained face images. Our scheme decomposes face images into three layers: foreground layers (including eyebrows, eyes, nose, and mouth), midground layers (skin), and background layers (other parts). LBFTI leverages dedicated generators to produce these layers, adopting a rigorous three-stage training strategy: (1) independent refined generation of foreground and midground layers, (2) fusion of foreground and midground layers with template secondary injection to produce complete panoramic face images with background layers, and (3) joint fine-tuning of all modules to optimize inter-layer coordination and identity consistency. Experiments demonstrate that our LBFTI not only outperforms state-of-the-art methods in machine authentication performance, with a 25.3% improvement in TAR, but also achieves better similarity in human perception, as validated by both quantitative metrics and a questionnaire survey.