Search papers, labs, and topics across Lattice.
1
0
3
Mitigating the bias introduced by Top-K retrieval in long-context transformers can be achieved by estimating the contribution of unretrieved tokens with a fixed-size feature map, significantly improving performance without increasing KV-cache reads.
