Search papers, labs, and topics across Lattice.
1
0
2
Sigmoid attention, while less effective in dense modeling, dramatically improves KV-cache eviction performance, challenging conventional wisdom about attention mechanisms.
