Search papers, labs, and topics across Lattice.
1
0
3
Ditch the computationally expensive and privacy-leaky DP-SGD on both teacher and student: this new distillation method achieves better privacy-utility trade-offs by applying DP only to the student, using on-policy rollouts from a frozen teacher.