Search papers, labs, and topics across Lattice.
Oklahoma State University
1
0
3
DistillCache retains over 94% accuracy on long-context tasks while slashing memory usage by 75%, outperforming traditional methods and setting a new standard for efficient LLM inference.
