Search papers, labs, and topics across Lattice.
This paper addresses the challenge of unlearning harmful concepts in diffusion models without inadvertently suppressing benign co-occurring concepts. By defining and quantifying these concepts through the CARE score, the authors introduce the ReCARE framework, which effectively safeguards these associated concepts while targeting specific harmful content for removal. Experimental results show that ReCARE outperforms existing methods in maintaining utility and preserving co-occurring concepts across various unlearning tasks.
Unlearning harmful content in diffusion models can now be achieved without sacrificing the generation of benign co-occurring concepts, thanks to the innovative ReCARE framework.
Unlearning has emerged as a key technique to mitigate harmful content generation in diffusion models. However, existing methods often remove not only the target concept, but also benign co-occurring concepts. As illustrated in Fig.1, unlearning nudity can unintentionally suppress the concept of person, preventing a model from generating images with person. We define these undesirably suppressed co-occurring concepts that must be preserved CARE (Co-occurring Associated REtained concepts). Then, we introduce the CARE score, a general metric that directly quantifies their preservation across unlearning tasks. With this foundation, we propose ReCARE (Robust erasure for CARE), a framework that explicitly safeguards CARE while erasing only the target concept. ReCARE automatically constructs the CARE-set, a curated vocabulary of benign co-occurring tokens extracted from target images, and leverages this vocabulary during training for stable unlearning. Extensive experiments across various target concepts (Nudity, Van Gogh style, and Tench object) demonstrate that ReCARE achieves overall state-of-the-art performance in balancing robust concept erasure, overall utility, and CARE preservation.
