Search papers, labs, and topics across Lattice.
1
0
3
0
Traditional load balancing in EP MoE serving can lead to inefficiencies, but a new makespan-aware dispatcher achieves up to 15.5% throughput gains by adapting to varying compute and memory constraints.
