Search papers, labs, and topics across Lattice.
This paper addresses the challenge of achieving predictive fairness in high-dimensional continuous sensitive attributes by optimizing mean demographic parity through a novel functional bilevel optimization approach. The authors introduce two algorithms, FBO and ITD, which effectively minimize fairness-accuracy regret while outperforming existing methods such as HSIC and adversarial schemes on both synthetic and semi-synthetic datasets. Key results indicate that these methods not only maintain fairness but also achieve competitive accuracy, demonstrating a significant advancement in the fairness-accuracy trade-off in predictive modeling.
Achieving predictive fairness without sacrificing accuracy, this study reveals that optimizing mean demographic parity can significantly reduce fairness-accuracy regret in high-dimensional settings.
When sensitive attributes are continuous and high-dimensional $-$ demographic score vectors, posteriors over attributes, age or income profiles $-$ enforcing full statistical independence is often too restrictive, and existing relaxations rely on indirect dependence penalties or adversarial schemes that do not directly target the fairness-accuracy trade-off. We instead consider mean demographic parity through DPVar, the variance of the conditional-mean prediction given the sensitive attribute, and show that optimizing it yields a functional bilevel problem. We propose two algorithms for this problem: FBO, which uses a closed-form adjoint we derive for the squared-loss case to obtain an exact hypergradient, and ITD, which differentiates through unrolled inner steps and extends beyond squared loss. On synthetic data and a new semi-synthetic benchmark built from 60 tabular regression datasets, both methods achieve the lowest or near-lowest aggregate fairness-accuracy regret, and consistently match or outperform strong HSIC, adversarial, linear-dependence, and generalized-DP baselines.