Search papers, labs, and topics across Lattice.
This paper introduces EraseSAE, a novel framework that employs sparse autoencoders for surgical concept erasure in text-to-video diffusion models, addressing the limitations of existing methods that fail to remove unwanted semantics effectively. By leveraging a partitioned convolutional sparse autoencoder, the approach disentangles dense spatiotemporal activations into interpretable features, allowing for precise isolation and removal of specific concepts while maintaining the integrity of unrelated content. Experimental results demonstrate that EraseSAE significantly outperforms state-of-the-art techniques in both effectiveness and quality preservation during the erasure process.
Achieving precise concept removal in text-to-video models without sacrificing generation quality could redefine safety standards in generative AI.
Recent advances in text-to-video (T2V) diffusion models have demonstrated remarkable generative capabilities, yet their reliance on loosely curated training data raises pressing safety and copyright concerns. Concept erasure offers a principled remedy by removing unwanted semantics from pretrained models while preserving remaining concepts. However, existing approaches typically operate at a coarse granularity misaligned with the fine-grained, distributed nature of concept representations, leading to incomplete removal or degraded generation quality. We argue that surgical erasure fundamentally requires intervention at the level of monosemantic features, where each unit encodes a single interpretable concept. To this end, we propose EraseSAE, a novel framework that leverages sparse autoencoders to achieve surgical concept erasure in DiT-based T2V diffusion models via a principled decompose-attribute-erase pipeline. We first introduce the Partitioned Convolutional Sparse Autoencoder, which decomposes dense spatiotemporal activations into disentangled, interpretable sparse features while preserving spatiotemporal coherence. A contrastive attribution mechanism then contrasts activations from paired prompts to isolate concept-specific feature kernels. At inference, timestep-resolved spatiotemporal masks derived from the identified kernels confine erasure to regions where the target concept is active, leaving unrelated content intact. Extensive experiments across diverse diffusion models and concept erasure tasks demonstrate that EraseSAE achieves precise and robust concept removal with minimal quality degradation, substantially outperforming state-of-the-art methods. The code is available at https://github.com/HiDream-ai/EraseSAE.
