Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper establishes a theoretical framework for integrating public data directly into differential privacy (DP) mechanisms for synthetic data generation, moving beyond existing indirect methods. By characterizing the asymptotically optimal domain-aware privacy mechanism using normalized histograms, the authors introduce PubMix, which enhances the quality of synthetic data while maintaining privacy. Experimental results reveal that PubMix outperforms traditional domain-agnostic DP mechanisms, highlighting its effectiveness in balancing privacy and statistical fidelity.
PubMix revolutionizes synthetic data generation by directly leveraging public data to enhance privacy without sacrificing quality.
Differential privacy (DP) imposes fundamental trade-offs between privacy and statistical fidelity in synthetic data generation. While access to public data has been shown to improve these trade-offs empirically, existing approaches use public data only indirectly, through pre-processing (e.g., using pre-trained generative models) or post-processing steps (e.g., matching target statistics estimated from public datasets), while relying on domain-agnostic DP mechanisms. In this work, we lay the theoretical framework to study the principled incorporation of public data into DP mechanisms themselves. We consider normalized histograms as distribution estimators and characterize the asymptotically optimal domain-aware privacy mechanism within a specific class of DP mechanisms. We introduce PubMix, a public-data-aware DP mechanism that can be used in histogram-based data synthesis pipelines. Our experiments demonstrate that PubMix significantly improves synthetic data generation quality compared to domain-agnostic privacy mechanisms.