Search papers, labs, and topics across Lattice.
This study introduces NeuroCogMap, a framework that organizes the internal features of large language models (LLMs) into functional parcels linked to cognitive capabilities and a cognitive hierarchy. The framework reveals that major LLM failures, such as hallucination and bias, correspond to specific disruptions in representational and behavioral-control systems, providing internal signatures for targeted interventions. Additionally, NeuroCogMap enhances the prediction of human cortical responses during language comprehension, suggesting a strong alignment with higher-order cognitive processes in humans.
Major LLM failures can be traced back to specific disruptions in cognitive organization, providing a roadmap for targeted interventions and deeper understanding of model behavior.
Understanding how complex cognitive functions are organized within artificial systems is central to interpreting large language models (LLMs) and relating them to biological cognition. Yet although LLMs exhibit broad cognitive-like behaviours, it remains unclear whether their internal representations form reproducible functional systems that explain behaviour, failure and links to human cognition. Here we present NeuroCogMap, a cognitive neuroscience-inspired framework that organizes internal features of LLMs into functional parcels and links them to interpretable functions, cognitive capabilities and a cognitive hierarchy. These parcels form a stable and semantically coherent organization that is partly conserved across models and functionally linked to model outputs. Within this organization, major LLM failures, including hallucination, bias, refusal failure and sycophancy, correspond to distinct disruptions in representational and behavioural-control systems, yielding internal signatures for mechanism-guided detection and targeted intervention. Beyond model behaviour, NeuroCogMap improves prediction of human cortical responses during naturalistic language comprehension, with the strongest correspondence in higher-order association cortex. At the cognitive level, its internal signatures expose latent strategies that guide refinements of classical models of human decision-making. Together, these findings establish NeuroCogMap as a system-level framework for mapping functional organization in artificial systems and for relating this organization to human cortical function and cognitive behaviour.
Tsinghua AI