Track trials, findings, and clinical evidence as it lands.
Search papers, labs, and topics across Lattice.
1
0
0
0
Speculative decoding now achieves 4x concurrency and 3.7x output throughput on 100K context LLMs by intelligently managing KV cache residency across GPU and host memory.