Search papers, labs, and topics across Lattice.
This paper investigates the vulnerability of federated learning to Source Inference Attacks (SIAs) under the shuffle model, where an adversary attempts to identify the client owning a specific data point used in training. The authors demonstrate that naive shuffling is insufficient to defend against SIAs and propose a novel defense mechanism combining parameter-level shuffling with the residue number system (RNS). Experimental results across various models and datasets confirm the ineffectiveness of standard shuffling and demonstrate that the proposed method effectively mitigates SIAs, reducing attack accuracy to near-random guessing levels without compromising model accuracy.
Standard shuffling in federated learning doesn't stop source inference attacks, but parameter-level shuffling with residue number systems does, without hurting accuracy.
Federated Learning (FL) was initially proposed as a privacy-preserving machine learning paradigm. However, FL has been shown to be susceptible to a series of privacy attacks. Recently, there has been concern about the Source Inference Attack (SIA), where an honest-but-curious central server attempts to identify exactly which client owns a given data point which was used in the training phase. Alarmingly, standard gradient obfuscation techniques with Differential Privacy have been shown to be ineffective against SIAs, at least without severely diminishing the accuracy. In this work, we propose a defense against SIAs within the widely studied shuffle model of FL, where an honest shuffler acts as an intermediary between the clients and the server. First, we demonstrate that standard naive shuffling alone is insufficient to prevent SIAs. To effectively defend against SIAs, shuffling needs to be applied at a more granular level; we propose a novel combination of parameter-level shuffling with the residue number system (RNS). Our approach provides robust protection against SIAs without affecting the accuracy of the joint model and can be seamlessly integrated into other privacy protection mechanisms. We conduct experiments on a series of models and datasets, confirming that standard shuffling approaches fail to prevent SIAs and that, in contrast, our proposed method reduce the attack's accuracy to the level of random guessing.
