Search papers, labs, and topics across Lattice.
Shanghai Jiao Tong University
1
0
2
1
HMA-Serve achieves 3.2x higher goodput and 4.8x better cost-efficiency by leveraging memory-heterogeneous accelerators, challenging the status quo of single-vendor LLM serving.
