Search papers, labs, and topics across Lattice.
This study investigates semantic navigation by comparing the search dynamics of humans and three large language models (LLMs) using verbal fluency data. By employing trajectory-based NLP metrics, the researchers quantified dimensions such as entropy, distance to next, and distance to centroid, revealing that humans demonstrate greater variability and exploratory behavior in semantic search compared to LLMs. The results indicate that existing model architectures do not capture the nuanced balance of local exploitation and global exploration seen in human semantic memory retrieval.
Humans navigate semantic space with a level of variability and exploration that current LLMs fail to replicate, highlighting fundamental differences in cognitive processing.
Semantic memory retrieval can be conceptualized as navigation through conceptual space. We compared semantic search dynamics between humans and three large language models (GPT-4o, Gemini-2.5-Pro, Claude-Sonnet-4.5) using verbal fluency data. By applying trajectory-based NLP metrics to the items generated by 82 human participants and LLM output across eight temperature settings, we quantified three complementary dimensions: entropy (step size predictability), distance to next (successive semantic steps), and distance to centroid (global dispersion). Humans exhibited higher entropy, larger semantic steps and broader dispersion than all LLMs, indicating more variable and exploratory search. Temperature tuning produced only partial alignments, as individual metrics matched between humans and LLMs at specific settings, but no configuration reproduced the complete human profile (in all dimensions). These findings suggest that human semantic search implements a distinctive balance between local exploitation and global exploration that current model architectures fail to reproduce.