Search papers, labs, and topics across Lattice.
ETH Zurich, Allen Institute for AI
1
0
1
9
Conventional RoPE's non-repeating rotations may hinder its ability to access distant context, unlike periodic RoPE, which excels at recognizing modular languages.