Search papers, labs, and topics across Lattice.
Tsinghua University
1
0
2
Larger sliding-window attention can paradoxically slow down the formation of critical retrieval mechanisms in language models, challenging conventional design assumptions.