Search papers, labs, and topics across Lattice.
1
0
3
Summary tokens are not just compressed context, but also dynamic KV cache indices, unlocking flexible memory compression and reduced compute in hybrid attention.