Search papers, labs, and topics across Lattice.
Affiliation:
1
0
0
6
Activating latent expert capacity within MoE models via bidirectional distillation unlocks performance gains exceeding even the expanded teacher, pushing the boundaries of efficient scaling.