Search papers, labs, and topics across Lattice.
BiasEdit is introduced, a training-free framework that detects and edits biases in visual datasets to improve fairness in image classifiers. It identifies unknown bias attributes using statistical dependence and mutual information analysis on visual-linguistic representations, then edits images using text-guided image editing to create bias-conflict samples. This approach avoids reliance on manual annotations or synthetic mixing, achieving state-of-the-art debiasing performance, even with fully biased training data.
Forget hand-labeled bias attributes: BiasEdit automatically detects and edits biases in image datasets, paving the way for fairer visual classifiers without extra training.
Visual data from the Web power image classifiers, which often underpin many web services, such as recommendation and content moderation. However, the raw Web data often contain spurious correlations and social biases, and neural networks are known for their tendency to learn biases present in data. This can reinforce unfairness in web services and the web data, leading to a vicious cycle. In the context of image classification, networks learn bias attributes for a specific class when a majority of images contain the same attribute only for a given class. Hence, training a fair and debiased classifier from a biased dataset demands handling an imbalanced problem between a majority of images with bias attributes (bias-aligned samples) and a minority without (bias-conflict samples). In this work, we introduce BiasEdit, a modular framework that automatically detects bias attributes from the original dataset and edits them to construct a debiased dataset. Specifically, BiasEdit first detects unknown bias attributes via statistical dependence and mutual information analysis of visual-linguistic representations, and then explicitly edits those attributes using text-guided image editing to generate realistic bias-conflict samples. Unlike prior works that assume known bias attributes or relies on synthetic mixing, our method operates without manual annotations and can leverage off-the-shelf vision-language and editing models. BiasEdit addresses a fundamental challenge in Web-sourced visual AI, mitigating dataset-induced bias and achieving state-of-the-art debiasing performance even when training data are fully biased.
