Search papers, labs, and topics across Lattice.
The paper demonstrates that perfect retraining-based machine unlearning, and its associated security definitions, can leak information about undeleted data points. It presents a reconstruction attack where an adversary controlling a small number of data points can reconstruct almost the entire dataset by issuing deletion requests to a perfect retraining unlearning mechanism. To mitigate this, the paper introduces a new security definition that protects undeleted data from leakage caused by deletions, while still allowing for essential functionalities like summations and statistical learning.
"Perfect retraining," the gold standard for machine unlearning, can catastrophically leak private information about the *undeleted* data.
Machine unlearning aims to remove specific data points from a trained model, often striving to emulate "perfect retraining", i.e., producing the model that would have been obtained had the deleted data never been included. We demonstrate that this approach, and security definitions that enable it, carry significant privacy risks for the remaining (undeleted) data points. We present a reconstruction attack showing that for certain tasks, which can be computed securely without deletions, a mechanism adhering to perfect retraining allows an adversary controlling merely $ω(1)$ data points to reconstruct almost the entire dataset merely by issuing deletion requests. We survey existing definitions for machine unlearning, showing they are either susceptible to such attacks or too restrictive to support basic functionalities like exact summation. To address this problem, we propose a new security definition that specifically safeguards undeleted data against leakage caused by the deletion of other points. We show that our definition permits several essential functionalities, such as bulletin boards, summations, and statistical learning.
