Search papers, labs, and topics across Lattice.
Shanghai Jiao Tong University
1
0
3
MoE serving can now scale 4.5x-11.7x faster by reusing existing runtime state, sidestepping costly instance reconstruction.