Search papers, labs, and topics across Lattice.
This paper introduces Data-Frugal Machine Unlearning (DFMU), a novel approach that minimizes the computational burden associated with machine unlearning by utilizing knowledge preserving pruning to compute importance scores with just a single forward and backward pass. The method significantly enhances retain-accuracy, achieving a 40% improvement with only 13% of the data samples compared to state-of-the-art techniques. Additionally, DFMU reduces the processing time for class forgetting by an average of 88%, making it a more efficient solution for safe model updates.
Achieving 40% more retain-accuracy with only 13% of the data samples, DFMU revolutionizes the efficiency of machine unlearning.
Machine unlearning is an emerging domain that ensures the safe removal of elements (includes concepts, attributes, entity and class) from the trained model along with least drop in model performance. The domain of machine unlearning brings its own indigenous challenges since the removal of pre-trained elements from model will always degrade the model performance on remaining elements. The existing methods basically rely on retraining for removal of elements from the pre-trained model, which is compute extensive. In this work, we propose a machine unlearning method which helps to reduce the computational requirement for faster retain-dataset accuracy convergence which also does not require extensive retraining of the pre-trained model. The proposed method, Data-Frugal Machine Unlearning (DFMU) requires only a single forward and backward pass for computing the importance score of various computational blocks of a model. The importance score computation is based on knowledge preserving pruning which helps to converge faster and requires far less data as compared to the existing methods. Experimentally, it achieves 40% more retain-accuracy with just 13% of data samples in comparison with SOTA method on various public datasets and also averages 88% faster processing time for forgetting a given class.
