Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
Affiliation:
1
0
2
A surprising 3.98–8.00% of Transformer heads achieve near closure under composition, revealing a hidden algebraic structure that could redefine our understanding of attention mechanisms.