Search papers, labs, and topics across Lattice.
2
0
3
9
Learning to prune key-value caches based on future token utility allows KVpop to achieve up to 88% compression while retaining nearly full performance.
xLSTM models can now effectively learn from large attention-based models, even outperforming their teachers on some tasks through a novel distillation and merging pipeline.