Search papers, labs, and topics across Lattice.
2
0
3
3
Transformers can length-generalize on specific regular languages, revealing a hidden algebraic property that classical finite decomposition theory fails to capture.
Transforming our understanding of Transformers, this work reveals that learnability may be as crucial as expressivity in optimizing large language models.
