Search papers, labs, and topics across Lattice.
1
0
GQA's KV-cache eviction overhead can be eliminated by pooling head importance with Renyi-2 entropy, achieving perfect budget preservation and needle recall where mean pooling fails.