Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces Fair Fine-tuning (FFt), a method designed to mitigate distribution inference attacks (DIA) by fine-tuning models under an Equalized Odds (EO) constraint using samples from a complementary distribution. The authors establish a theoretical framework that links the model's EO disparity to its adversarial advantage, proving that the adversarial advantage is bounded by the distinguishability of training distributions. Empirical results demonstrate that FFt significantly reduces the adversarial accuracy gap across various datasets, achieving a reduction from approximately 15% to under 4% on the ACS Income dataset.
Fine-tuning with fairness constraints can cut adversarial accuracy gaps by over 10%, transforming how we approach privacy in machine learning.
Machine learning models trained on sensitive data can inadvertently leak population-level information about their training distributions -- a threat known as distribution inference attack (DIA). An adversary with black-box access can infer sensitive demographic properties, such as subgroup proportions, without observing any training data directly. While defenses such as differential privacy and property unlearning have been proposed, the link between fairness constraints and distributional leakage remains unexplored. We propose Fair Fine-tuning (FFt): a trained model is fine-tuned on samples from the complementary distribution under an Equalized Odds (EO) constraint. We provide a complete theoretical characterization, proving the tight bound $\text{Adv}(\mathcal{A},M_f) \le Δ_{\text{EO}} \cdot W$, where $W$ quantifies how distinguishable the two training distributions are by their sensitive-attribute composition. We also establish a necessary condition for FFt to reduce adversarial advantage and prove tightness of the bound. We evaluate across six datasets spanning tabular (ACS Income, COMPAS, German Credit), image (UTKFaces), and NLP (Bias in Bios) modalities. Rehearsal-based FFt consistently reduces the adversarial accuracy gap below the detection threshold $τ!=!0.1$ across all settings; on ACS Income, the gap falls from $\sim!15%$ to under $4%$. Our work provides the first formal bound connecting a model's measured EO disparity directly to its adversarial advantage in the DIA game, opening a new avenue for unified fairness-and-privacy defenses.