Search papers, labs, and topics across Lattice.
Affiliation:
1
0
3
6
Traditional load balancing in EP MoE serving can lead to inefficiencies, but a new makespan-aware dispatcher achieves up to 15.5% throughput gains by adapting to varying compute and memory constraints.
