Search papers, labs, and topics across Lattice.
The University of Melbourne
1
12
3
System-aware optimizations in KV cache design could dramatically reduce the memory footprint and costs of serving large language models.
