Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study investigates how large language models (LLMs) discern animacy in language by identifying specific causal mechanisms within their architectures. Using a controlled dataset of minimal pairs and circuit discovery techniques across four open-weight models, the authors reveal the existence of an animacy circuit that is less localized and more distributed than other known circuits. The findings highlight the complexity of animacy processing in LLMs, indicating that while a causal mechanism exists, its application varies across models and tasks, underscoring the nuanced nature of animacy understanding in AI.
LLMs possess a distributed animacy circuit that reveals the intricate, context-dependent nature of how they process animate and inanimate concepts.
Distinguishing animate from inanimate concepts in written language requires more than shallow text processing, as it involves recognizing complex selectional constraints and contextual cues, such as verb-argument interactions. Yet, current large language models (LLMs) appear to be capable of doing it. We investigate whether this animacy-sensitive behavior of LLMs can be traced to a localized set of causally relevant components and connections. To do so, we construct a controlled dataset of minimal pairs and perform circuit discovery on four open-weight models. Through in-depth experiments and ablations, we show that a causal mechanism responsible for handling animacy in these models does exist, thus discovering an animacy circuit. At the same time, this circuit appears to be less localized compared to other known ones and generalizes only partially across models and animacy tasks, confirming the distributed, context-dependent, and somewhat graded nature of the animacy concept.