Search papers, labs, and topics across Lattice.
This paper introduces Differentially Private On-Policy Distillation (DP-OPD), a novel framework for privately fine-tuning language models that avoids DP-SGD on the teacher model. DP-OPD distills knowledge from a frozen, non-private teacher by training a student with DP-SGD on student-generated trajectories, using private generalized knowledge distillation on continuation tokens. Experiments show that DP-OPD achieves better perplexity than existing DP fine-tuning and distillation methods under a strict privacy budget, while also simplifying the training pipeline by eliminating the need for DP teacher training and offline synthetic text generation.
Ditch the computationally expensive and privacy-leaky DP-SGD on both teacher and student: this new distillation method achieves better privacy-utility trade-offs by applying DP only to the student, using on-policy rollouts from a frozen teacher.
Large language models (LLMs) are increasingly adapted to proprietary and domain-specific corpora that contain sensitive information, creating a tension between formal privacy guarantees and efficient deployment through model compression. Differential privacy (DP), typically enforced via DP-SGD, provides record-level protection but often incurs substantial utility loss in autoregressive generation, where optimization noise can amplify exposure bias and compounding errors along long rollouts. Existing approaches to private distillation either apply DP-SGD to both teacher and student, worsening computation and the privacy--utility tradeoff, or rely on DP synthetic text generation from a DP-trained teacher, avoiding DP on the student at the cost of DP-optimizing a large teacher and introducing an offline generation pipeline. We propose \textbf{Differentially Private On-Policy Distillation (DP-OPD)}, a synthesis-free framework that enforces privacy solely through DP-SGD on the student while leveraging a frozen teacher to provide dense token-level targets on \emph{student-generated} trajectories. DP-OPD instantiates this idea via \emph{private generalized knowledge distillation} on continuation tokens. Under a strict privacy budget ($\varepsilon=2.0$), DP-OPD improves perplexity over DP fine-tuning and off-policy DP distillation, and outperforms synthesis-based DP distillation (Yelp: 44.15$\rightarrow$41.68; BigPatent: 32.43$\rightarrow$30.63), while substantially simplifying the training pipeline. In particular, \textbf{DP-OPD collapses private compression into a single DP student-training loop} by eliminating DP teacher training and offline synthetic text generation. Code will be released upon publication at https://github.com/khademfatemeh/dp_opd.
