Search papers, labs, and topics across Lattice.
This paper introduces a novel approach to enhance the safety of text-to-image (T2I) generation by regulating attention dynamics through introspective analysis during inference. By rebalancing attention activations, the method effectively steers the model away from generating unsafe content while maintaining semantic alignment and perceptual quality. The results demonstrate significant improvements in safety scores across standard and adversarial benchmarks, suggesting that attention-space regulation is a more effective strategy than traditional concept erasure techniques.
Introspective attention modulation can significantly enhance the safety of T2I models without sacrificing quality, outperforming existing methods like concept erasure.
State-of-the-art flow based text-to-image (T2I) models exhibit remarkable generative abilities but remain vulnerable to producing unsafe content. Prior safety efforts range from concept erasure and prompt filtering to classifier-based gating. However, simple techniques like parameter efficient adaptations of the models easily bypass such guardrails. We introduce a unique principled approach that achieves safety by regulating the model's attention dynamics through inference-time introspection, exhibiting intrinsic robustness. Our method analyzes and rebalances attention activations throughout image synthesis, steering generations away from unsafe concepts while preserving semantic alignment. This introspective control ensures safety of deployed models. Across standard and adversarial safety benchmarks, our approach achieves remarkable safety scores while maintaining or even improving alignment and perceptual quality. Our results reveal that attention-space regulation offers a considerably more promising path to safer diffusion transformer based image generation than the existing concept erasing mechanism.Our code can be accessed at https://basim-azam.github.io/iam/
