Search papers, labs, and topics across Lattice.
Institute of Parallel and Distributed Systems, Shanghai Jiao Tong University
2
0
4
Balancing session-centric scheduling can boost LLM cluster throughput by up to 16% without sacrificing token reuse.
Forget complex combinators: a simple multiplication trick can slash LLM latency by 92% and boost throughput by 21%, outperforming production schedulers.
