Search papers, labs, and topics across Lattice.
1
0
3
MoE students can not only match but often surpass their dense teacher counterparts using a novel distillation framework that optimizes routing policies without explicit guidance.
