Search papers, labs, and topics across Lattice.
Affiliation:
1
0
2
Self-distillation can degrade student performance if the teacher exploits privileged information unavailable to the student, but a novel KL-regularized objective ensures teacher guidance aligns with student capabilities.
