Search papers, labs, and topics across Lattice.
1
0
3
4
On-policy distillation can lead to catastrophic length inflation in student models, but a simple fix stabilizes training and boosts performance by 7%.