Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
Affiliation:
1
0
1
2
A mean-field analysis of attention, which shows how the average attention from one token to another defines a kernel that carries representations layer to layer and can be iterated through the network to model how the geometry is transformed.