Search papers, labs, and topics across Lattice.
This study evaluates the effectiveness of sparse autoencoders (SAEs) for concept-level manipulation in diffusion models, particularly focusing on object erasure and steering. The authors find that while SAEs can accurately detect and localize semantic concepts, direct interventions in their latent space often lead to out-of-distribution activations and visual artifacts. By employing SAEs solely as semantic detectors to identify and replace image regions, the researchers achieve cleaner erasure results, revealing a critical distinction between detection and intervention capabilities in diffusion models.
Direct manipulation of latent spaces in diffusion models can lead to severe visual artifacts, but using sparse autoencoders for semantic detection offers a cleaner alternative for object erasure.
Sparse autoencoders (SAEs) have recently been proposed as interpretable tools for concept-level manipulation, under the assumption that isolated features can serve as controllable intervention points. In this work, we systematically evaluate this assumption in the context of object erasure and steering in diffusion models. We show that while SAEs reliably detect and localize semantic concepts within diffusion model activations, direct intervention in their latent space frequently induces out-of-distribution activations, resulting in severe visual artifacts. To disentangle detection from intervention, we use SAE activations purely as semantic detectors to identify image regions containing the target object, and replace those patch embeddings with the ones that do not contain it. This detection-based replacement preserves the diffusion model's activation statistics and produces significantly cleaner erasure results than latent steering. Our findings reveal a fundamental gap between concept detection and concept intervention in diffusion models: monosemantic or sparse features are not inherently suitable as control knobs for steering. These results position SAEs as powerful interpretability tools for analyzing generative models, but highlight important limitations when used for direct manipulation, such as unlearning.
