Search papers, labs, and topics across Lattice.
This study investigates the representational geometry of large language models (LLMs) by adapting a contextual reversal-learning paradigm to compare human and LLM reasoning abilities. The results reveal that while LLMs demonstrate generalizable reasoning less frequently than humans, their internal representations exhibit hierarchical abstract geometric structures akin to those found in the human hippocampus. Notably, interventions that manipulate geometric properties in LLMs enhance their capacity for generalizable inference, highlighting the role of representational geometry in model reasoning processes.
LLMs may not reason as often as humans, but when they do, their internal representations mirror the abstract geometric structures of the human brain.
A defining feature of human intelligence is the ability to adapt to changing environments by inferring latent task structure from sparse observations. Neuroscientific research indicates that this capability relies on the hippocampus constructing abstract representations, expressed as low-dimensional, approximately orthogonal manifolds in neural state space. However, the internal mechanisms of large language models (LLMs) remain largely opaque, making it unclear whether they form comparable abstract representations or instead rely on task-specific statistical regularities when performing comparable reasoning tasks. Here we adapt a contextual reversal-learning paradigm to a text-based setting and compare humans and LLMs at both the Behavioural and representational levels. We report that although LLMs exhibit generalizable reasoning less frequently than humans, when such inference occurs, their internal states exhibit abstract geometric structures that resemble those reported in the hippocampus. Notably, this representational geometry is not uniformly distributed but is organized hierarchically across model depth: whereas lower layers show early, stable encoding of stimulus identity, higher layers form a hippocampal-like functional band enriched for abstract context geometry associated with inference. Furthermore, complementary intervention experiments mechanistically implicate geometry in reasoning: task-sequence language modelling induces geometric disentanglement, whereas geometric regularization of higher layers increases the emergence of generalizable inference. Together, these findings establish abstract representational geometry as a mechanistic principle supporting inference in large language models.
Tsinghua AI