Search papers, labs, and topics across Lattice.
Harbin Engineering University
1
0
2
SPRI achieves a remarkable 3.39 BLEU point improvement over the best existing MoE upcycling method, demonstrating that pretrained weight structures can be effectively leveraged for better expert diversity.
