Search papers, labs, and topics across Lattice.
This paper investigates the effects of machine unlearning on model performance across different domains by employing a label-conditioned energy-based model (EBM) that quantifies per-class energies. The authors demonstrate that by manipulating energy levels associated with specific classes, they can effectively forget targeted classes while preserving the integrity of other classes, achieving up to 99% forgetting error in certain cases. Their experiments on DomainNet and CIFAR-10 reveal that unlearning can be highly effective, with minimal impact on the accuracy of retained classes, suggesting a nuanced approach to model updates in dynamic environments.
Forgetting a class can be done with up to 99% accuracy while preserving the performance of other classes, revealing a new frontier in machine unlearning.
Machine unlearning removes the influence of specific data from a trained model. However, most methods treat the forgotten concept as isolated. In this paper, we study what happens to the rest of the model when a class is forgotten, using a label-conditioned energy-based model (EBM) that assigns per-class energies, making the effect directly observable. We forget a class by raising the energy of its image-label pairs, training with a forget term, a retain anchor to the pretrained model, a global margin, and an energy regularizer that stops the energy magnitudes from growing without limit. A propagation term applies the same forget signal to retain samples, weighted by each sample's DINOv2 similarity to the forget class, so forgetting reaches images that resemble it and leaves the rest untouched. We evaluate on two benchmark datasets: 1) On a subset of DomainNet across four visual domains, we forget tiger, lion, and scissors one at a time. Forgetting a class in the sketch domain also erases it from real, clipart, and painting, with forgetting error reaching 98% and 99% for lion and scissors, and the effect carrying over to the most similar class. 2) On CIFAR-10, we turn off the propagation term and forget each of the ten classes on its own. Forgetting is complete (100%), while the other nine classes retain 98.5% of their pre-unlearning accuracy on average.
