Search papers, labs, and topics across Lattice.
1
0
Archiving quantized KV states can shrink memory usage by up to 54x without sacrificing retrieval speed or accuracy.
