Search papers, labs, and topics across Lattice.
This paper introduces Phantom, a comprehensive framework designed to enhance protection against face-swapping deepfakes by applying both latent and spatial constraints. By synthesizing identity-shifted targets that preserve attributes and confining perturbations to semantically relevant facial regions, Phantom significantly improves the success rates of dodging attacks against state-of-the-art face-swapping models. The framework not only boosts protection success rates by up to 27.8% across various models but also enhances visual quality and generalizes effectively to impersonation scenarios.
Phantom achieves a remarkable 27.8% increase in deepfake protection success rates while maintaining high visual fidelity, redefining standards for facial privacy safeguards.
Face-swapping deepfakes pose an escalating threat to personal privacy by enabling unauthorized identity manipulation. While adversarial approaches have demonstrated success against black-box face recognition (FR) models, their applicability to face-swapping scenarios remains underexplored. In particular, reliance on fixed or random targets yields ambiguous latent guidance, and the lack of explicit spatial constraints causes perturbations to spill into identity-irrelevant regions. These issues are further exacerbated by identity-style disentanglement, which suppresses adversarial signals during deepfake generation. In this paper, we present Phantom, a unified face-swap deepfake protection framework that jointly constrains perturbations in latent and spatial domains. Phantom adaptively synthesizes identity-shifted yet attribute-preserving targets to guide identity-aware latent optimization, and applies masked perturbations confined to semantically relevant facial regions. Extensive experiments on state-of-the-art face-swapping deepfakes demonstrate that Phantom improves protection success rates in dodging scenarios by 27.8%, 25.6%, and 16.6% on UniFace, INSwapper, and SimSwap, respectively, while also enhancing visual quality. Furthermore, Phantom generalizes to impersonation scenario, yielding up to 10.2% higher protection while improving perceptual fidelity. These results underscore the effectiveness of jointly leveraging latent and spatial constraints for robust and coherent facial privacy protection.
