Search papers, labs, and topics across Lattice.
The paper addresses the problem of "harmful conflicts" in text-to-image diffusion models, where safety guidance aimed at mitigating one type of harm inadvertently amplifies another. To resolve this, they propose Conflict-aware Adaptive Safety Guidance (CASG), a training-free framework that dynamically identifies and applies category-aligned safety direction during image generation. CASG, composed of Conflict-aware Category Identification (CaCI) and Conflict-resolving Guidance Application (CrGA), achieves state-of-the-art performance by reducing the harmful rate by up to 15.4% compared to existing methods on T2I safety benchmarks.
Existing safety guardrails for text-to-image models can backfire, inadvertently amplifying other types of harm, but this new method adaptively steers generation to resolve these conflicts and reduce overall harmful content.
Text-to-Image (T2I) diffusion models have demonstrated significant advancements in generating high-quality images, while raising potential safety concerns regarding harmful content generation. Safety-guidance-based methods have been proposed to mitigate harmful outputs by steering generation away from harmful zones, where the zones are averaged across multiple harmful categories based on predefined keywords. However, these approaches fail to capture the complex interplay among different harm categories, leading to "harmful conflicts" where mitigating one type of harm may inadvertently amplify another, thus increasing overall harmful rate. To address this issue, we propose Conflict-aware Adaptive Safety Guidance (CASG), a training-free framework that dynamically identifies and applies the category-aligned safety direction during generation. CASG is composed of two components: (i) Conflict-aware Category Identification (CaCI), which identifies the harmful category most aligned with the model's evolving generative state, and (ii) Conflict-resolving Guidance Application (CrGA), which applies safety steering solely along the identified category to avoid multi-category interference. CASG can be applied to both latent-space and text-space safeguards. Experiments on T2I safety benchmarks demonstrate CASG's state-of-the-art performance, reducing the harmful rate by up to 15.4% compared to existing methods.
Meta AI