Search papers, labs, and topics across Lattice.
This paper reexamines the fairness concept of disparate impact in synthetic data generation (SDG), emphasizing the need for utility parity across sensitive groups rather than merely correcting biases in real data distributions. The authors identify key factors that lead to disparate outcomes in SDG, including distribution complexity, sampling errors, and differential privacy-induced estimation errors. By proposing a strategy for learning group-wise SDG models, they demonstrate significant improvements in both utility and fairness across various datasets.
Achieving fairness in synthetic data generation isn't just about bias correction鈥攊t's about ensuring utility parity across sensitive groups, and this paper reveals how to do it effectively.
We revisit the fairness notion of disparate impact for synthetic data generation (SDG), that assesses whether the utility of generated records is the same across sensitive groups. Our approach departs from existing work on fair SDG, that address the problem of correcting for undue biases in the observed distribution, hence redefining SDG as learning a distribution that is not that of the real data. By contrast, non-disparate impact is notably achieved when the synthetic and real distributions are the same. We expose reasons why SDG may fail to reach that solution and discuss why approximation and estimation errors occur and can be disparate across groups. We notably look into the expressive power of SDG methods relative to distribution complexity, sampling errors due to group proportions, and estimation errors induced by differential privacy mechanisms. We illustrate cases of disparate impact on both artificial and real-world data, focusing on SDG methods that rely on probabilistic graphical models. We also introduce a strategy of learning group-wise SDG models and illustrate how it can improve both the overall utility and its parity in many settings.
