Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
PATE-TabTransGAN is introduced, a novel framework for generating differentially private synthetic tabular data. It combines the Private Aggregation of Teacher Ensembles (PATE) mechanism with a Transformer-based student discriminator to model inter-feature dependencies while ensuring formal (ε, δ)-DP guarantees. Experiments on four tabular benchmarks demonstrate that PATE-TabTransGAN achieves state-of-the-art or competitive utility compared to existing DP tabular synthesis methods.
You can get state-of-the-art differentially private tabular data synthesis by using a Transformer-based discriminator within a PATE framework.
Generating high-fidelity synthetic tabular data under formal differential privacy guarantees remains an open challenge. Methods that provide strong theoretical protection typically sacrifice the modeling of inter-feature dependencies required for realistic synthesis, while architectures that excel at capturing complex column relationships offer only empirical privacy guarantees. We present PATE-TabTransGAN, a generative framework that integrates the Private Aggregation of Teacher Ensembles (PATE) mechanism with a Transformer-based student discriminator to jointly address both requirements, and employs a GNMax RDP accountant for numerically stable privacy accounting. An ensemble of Logistic Regression teachers trained on disjoint partitions supervise the student via noisy-aggregated labels, and a residual generator is optimized against this differentially private student, inheriting formal (ε, δ)-DP guarantees by post-processing. PATE-TabTransGAN was compared with PATE-GAN, DP-GAN, and DP-CTGAN, considered state-of-the-art in differentially private tabular synthesis. Experiments conducted on four tabular benchmarks (Adult, Breast, Cardio, Cervical) confirmed the high quality of the proposed method: PATE-TabTransGAN attains the best or tied-best AUROC on all four datasets. On AUCPR it matches the strongest baseline on Cardio, leads on Cervical, and trails on Breast; on Adult, we demonstrate that AUCPR is highly sensitive to positive-class convention, and that the observed gap is consistent with a convention difference between evaluation pipelines rather than a synthesis deficit.