Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
Clemson University
1
0
2
Stop wasting bits: dynamically quantizing the KV-cache based on token importance slashes latency and boosts accuracy for on-device LLMs, outperforming static quantization.