Search papers, labs, and topics across Lattice.
This study redefines concept representation in neural networks by modeling them as point-cloud manifolds influenced by contextual transformations represented as vector fields. By analyzing six different large language models, the authors reveal that context induces distinct and semantically organized displacements in concept representations, which correlate with properties like lexical concreteness. Notably, the shared geometric structure of these transformations across models suggests a commonality in how concepts are understood and modified by context, challenging the prevailing view of static concept representations.
Contextual transformations in language models reveal a shared geometric structure that organizes concept representations semantically, challenging the notion of static concepts.
How concepts are represented in neural networks is a fundamental question in machine learning. The dominant view treats concept representations as stationary geometric objects. Yet concepts appear in context, and context transforms them. Drawing from neural population geometry, we formalize concept representations as point-cloud manifolds and contextual transformations as vector fields, and instantiate this framework in large language models. Across six model families of varying scales, we find that context moves each concept differently. The variance in these displacements is semantically organized, correlating with lexical concreteness and density. Importantly, both the concepts being transformed and this variance structure are shared across models: displacement structure transported from one model predicts held-out displacements in others significantly above chance. Together, these findings show that models share a common geometry not only in how concepts are represented, but more importantly in how context transforms them, a structure with richer organization than prior work has recognized.
