Search papers, labs, and topics across Lattice.
Hanyang University
2
0
3
ShuntServe achieves up to 1.42x higher throughput and 31.9% cost efficiency improvements by leveraging heterogeneous GPU clusters for LLM serving.
LENS achieves an impressive 2.15% mean prediction error in latency estimation for LLM inference on NPUs, even without access to microarchitecture details.
