Search papers, labs, and topics across Lattice.
This paper introduces an innovative audio-driven defense mechanism for 3D talking face generation that shifts the protective focus from visual to audio modalities. By utilizing psychoacoustic masking, the method embeds protective perturbations within frequency regions that are less perceptible, effectively degrading the performance of identity impersonation while maintaining high visual fidelity. Experimental results confirm that this approach significantly enhances privacy protection without compromising the quality of the generated faces.
Shifting the defense from visual to audio, this method effectively thwarts identity impersonation in 3D talking face generation while preserving visual quality.
The rapid development of generative portrait models has raised growing concerns about privacy leakage and identity misuse. In particular, audio-driven 3D talking face generation can reconstruct a reusable 3D portrait of a target person from a monocular video and animate it with arbitrary speech, making realistic identity impersonation alarmingly practical. Existing proactive defenses mainly operate in the visual domain by injecting subtle perturbations into acial regions to disrupt identity acquisition. However, such perturbations often compromise visual quality due to the strong structural priors and social sensitivity of human faces, and are easily weakened by common real-world transformations such as resizing. To overcome these limitations, we propose an imperceptible audio defense for audio-driven 3D talking face generation by shifting protection from the visual modality to the audio modality. Specifically,we exploit psychoacoustic masking to hide protective perturbations within perceptually masked frequency regions of the speech signal, thereby reducing perceptual distortion while suppressing reliable facial animation. Extensive experiments demonstrate that the proposed method effectively degrades 3D talking face generation while preserving favorable perceptual quality. These findings highlight psychoacoustically guided audio perturbations as a practical and promising direction for privacy-preserving portrait protection.
