Search papers, labs, and topics across Lattice.
J眉lich Research Center, Helmholtz Munich
2
0
3
A first-order phase transition in softmax attention reveals how copy mechanisms emerge abruptly during training, challenging existing notions of gradual feature learning.
RNNs and DNNs behave identically until a phase transition where RNNs uniquely develop correlated representations across timesteps, offering a new perspective on their distinct functional properties.
