Search papers, labs, and topics across Lattice.
School of Electrical and Computer Engineering, University of Sydney, Darlington, NSW, Australia, School of Electrical and Computer Engineering, The University of Sydney, Darlington, NSW, Australia, Y. Zhang, Y. Yan, N. Yang and D. Yuan are with the School of Electrical and Computer Engineering, The University of Sydney, Darlington, NSW 2008, Australia. (Email: yuning.zhang1@sydney.edu.au; yyan0244@uni.sydney.edu.au; n.yang@sydney.edu.au; dong.yuan@sydney.edu.au). The corresponding author is D. Yuan
1
0
3
2
Stop leaving performance on the table: jointly optimizing resource allocation and request batching with reinforcement learning can yield up to 24x speedups for multi-tenant GPU inference.
