Search papers, labs, and topics across Lattice.
New York University Center for Data Science , NYU Shanghai
1
0
2
3
Routing robustness, not just load balancing, is the key to reliable sparse MoE scaling, with DRMoET boosting performance by 1.4% on a 10.3B parameter model.
