Search papers, labs, and topics across Lattice.
Affiliation:
1
0
34
Forward KL divergence in distillation inflates student entropy, while reverse KL can deflate it, offering a new lens on implicit regularization.