Search papers, labs, and topics across Lattice.
Northeastern University
2
0
4
SPRI achieves a remarkable 3.39 BLEU point improvement over the best existing MoE upcycling method, demonstrating that pretrained weight structures can be effectively leveraged for better expert diversity.
