Search papers, labs, and topics across Lattice.
This paper introduces CoreUnlearn, a novel approach for concept unlearning in text-guided diffusion models that addresses ethical concerns related to privacy and harmful content generation. By employing a Component Extraction Module (CEM) and a Swap Disentangling Strategy (SDS), CoreUnlearn disentangles concept embeddings to selectively erase undesirable components while preserving model utility. Experimental results show that CoreUnlearn effectively removes harmful concepts with minimal degradation in overall model performance, marking a significant advancement in ethical AI practices.
CoreUnlearn enables targeted erasure of harmful concepts in diffusion models without sacrificing performance, redefining ethical standards in AI-generated content.
Text guided diffusion models have revolutionized image synthesis but also raise ethical concerns, such as privacy violation and harmful content generation. To mitigate these issues, prevailing methods typically leverage an alignment mechanism, with predefined erasure references, to fine-tune pretrained model weights. However, these techniques are intrinsically limited by the representational capacity of textual space and display high sensitivity to the choice of predefined erasure references, e.g., suboptimal references may significantly affect the model utility preservation during erasure. To overcome these limitations, we introduce CoreUnlearn, aiming to disentangle and remove the erasure-critical component of the undesirable concept. Specifically, CoreUnlearn comprises a Component Extraction Module (CEM) and a Swap Disentangling Strategy (SDS). Guided by SDS, CEM is pre-trained to decompose concept embeddings into distinct component types. Leveraging this decomposition, CoreUnlearn then removes the erasure-critical component while retaining non-critical ones by fine-tuning model weights. Extensive experiments demonstrate that CoreUnlearn achieves effective concept erasure with minimal impact on overall model performance.
