Search papers, labs, and topics across Lattice.
1
0
2
INT4 KV caching for MLA models is now possible, achieving 3.59x compression at 128K context and enabling 5.168x higher throughput in cache-pressure serving workloads.
