Search papers, labs, and topics across Lattice.
Department of Computer Science, Grinnell College
1
0
2
Nexus Sampling retains crucial tokens during KV cache eviction, achieving near-dense attention performance with dramatically reduced memory usage.
