Search papers, labs, and topics across Lattice.
This paper investigates the emergence of geometric structures in LLM representations, such as circular arrangements of calendar months, and links them to translation symmetries in language statistics. The authors prove that these symmetries in co-occurrence probabilities dictate the observed geometric structures in high-dimensional word embeddings. They further demonstrate that these structures are robust to perturbations in co-occurrence statistics due to an underlying continuous latent variable, validating this framework across various language models.
Language models organize concepts like months and years into surprisingly clean geometric structures because of hidden symmetries in language statistics, even when those statistics are heavily perturbed.
Although learned representations underlie neural networks' success, their fundamental properties remain poorly understood. A striking example is the emergence of simple geometric structures in LLM representations: for example, calendar months organize into a circle, years form a smooth one-dimensional manifold, and cities' latitudes and longitudes can be decoded by a linear probe. We show that the statistics of language exhibit a translation symmetry -- e.g., the co-occurrence probability of two months depends only on the time interval between them -- and we prove that the latter governs the aforementioned geometric structures in high-dimensional word embedding models. Moreover, we find that these structures persist even when the co-occurrence statistics are strongly perturbed (for example, by removing all sentences in which two months appear together) and at moderate embedding dimension. We show that this robustness naturally emerges if the co-occurrence statistics are collectively controlled by an underlying continuous latent variable. We empirically validate this theoretical framework in word embedding models, text embedding models, and large language models.
