Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a lightweight, tuning-free method called Embedding Arithmetic for mitigating social bias in text-to-image models without altering model weights, prompts, or datasets. By analyzing the structure of bias in the embedding space, the method allows for fine-grained control over the fairness-coherence trade-off, ensuring that prompt semantics and visual context remain intact. Experiments demonstrate that this approach significantly enhances diversity while maintaining high concept coherence, outperforming existing baselines and providing a geometric understanding of latent space for more ethical image generation.
A new method can mitigate social bias in text-to-image models without sacrificing prompt semantics or visual context, offering unprecedented control over fairness and coherence.
Modern text-to-image (T2I) models amplify harmful societal biases, challenging their ethical deployment. We introduce an inference-time method that reliably mitigates social bias while keeping prompt semantics and visual context (background, layout, and style) intact. This ensures context persistency and provides a controllable parameter to adjust mitigation strength, giving practitioners fine-grained control over fairness-coherence trade-offs. Using Embedding Arithmetic, we analyze how bias is structured in the embedding space and correct it without altering model weights, prompts, or datasets. Experiments on FLUX 1.0-Dev and Stable Diffusion 3.5-Large show that the conditional embedding space forms a complex, entangled manifold rather than a grid of disentangled concepts. To rigorously assess semantic preservation beyond the circularity and bias limitations of of CLIP scores, we propose the Concept Coherence Score (CCS). Evaluated against this robust metric, our lightweight, tuning-free method significantly outperforms existing baselines in improving diversity while maintaining high concept coherence, effectively resolving the critical fairness-coherence trade-off. By characterizing how models represent social concepts, we establish geometric understanding of latent space as a principled path toward more transparent, controllable, and fair image generation.