Search papers, labs, and topics across Lattice.
This paper introduces DecoyFace, a novel framework for privacy-preserving face recognition that mitigates feature inversion attacks by steering unauthorized reconstructions towards plausible but incorrect identities. By decomposing intermediate representations into reconstruction-sensitive and complementary subspaces, the framework injects decoy identity cues while retaining essential recognition information. Experiments demonstrate that DecoyFace achieves competitive recognition accuracy while significantly reducing identity leakage to 2.93% under U-Net attacks and 0.74% under Flow-Matching attacks, with visually imperceptible reconstructions.
Identity leakage drops to just 0.74% while maintaining high recognition accuracy, thanks to an innovative decoy-oriented approach in face recognition.
Split face recognition reduces client-side computation but exposes intermediate features to feature inversion attacks and unauthorized analysis by honest-but-curious (HBC) servers. Existing privacy-preserving face recognition methods mainly aim to resist unauthorized reconstruction, typically producing features whose inversion yields visibly degraded results, which may reveal the existence of protection and motivate adaptive attacks. To address this issue, we propose DecoyFace, an imperceptible decoy-oriented framework that steers unauthorized reconstruction toward a plausible but incorrect identity while preserving recognition utility. The key idea is to decompose the intermediate representation into a reconstruction-sensitive subspace and its complementary subspace. The client injects decoy identity cues into the reconstruction-sensitive subspace, while limited recognition-relevant evidence from the true sample is retained in the complementary subspace. On the server side, an authorized canonicalization module suppresses decoy-dominant components and recovers a recognition-friendly representation. This design addresses both attacker-side inversion from intercepted features and HBC server-side reconstruction from canonicalized representations. Experiments show that DecoyFace preserves competitive recognition accuracy while substantially reducing identity leakage to 2.93% under U-Net attacks and 0.74% under Flow-Matching attacks while yielding visually plausible and imperceptible reconstructions, with over 99.78% face validity on LFW dataset.
