Search papers, labs, and topics across Lattice.
This paper investigates the semantic structure of feature space in LLMs by projecting word embeddings onto 32 semantic axes and comparing the resulting projections with human ratings. The study finds strong correlations between LLM feature geometry and human semantic associations, including relationships between semantic axes and spillover effects when steering words along these axes. This suggests that LLM representations capture human-like semantic relationships in their hidden states.
LLMs aren't just memorizing words; they're organizing them in a feature space that mirrors the nuanced semantic relationships humans perceive.
We show that the geometric relations between semantic features in large language models' hidden states closely mirror human psychological associations. We construct feature vectors corresponding to 360 words and project them on 32 semantic axes (e.g. beautiful-ugly, soft-hard), and find that these projections correlate highly with human ratings of those words on the respective semantic scales. Second, we find that the cosine similarities between the semantic axes themselves are highly predictive of the correlations between these scales in the survey. Third, we show that substantial variance across the 32 semantic axes lies on a low-dimensional subspace, reproducing patterns typical of human semantic associations. Finally, we demonstrate that steering a word on one semantic axis causes spillover effects on the model's rating of that word on other semantic scales proportionate to the cosine similarity between those semantic axes. These findings suggest that features should be understood not only in isolation but through their geometric relations and the meaningful subspaces they form.
