Search papers, labs, and topics across Lattice.
This study investigates how large language models (LLMs) represent and retrieve singular and plural entities during coreference resolution, employing mechanistic interpretability and attention pattern analysis. The authors identify specific attention heads responsible for encoding coreference information, recognizing plural entities, and selecting antecedents for pronoun prediction. Notably, the findings reveal that LLMs exhibit a human-like preference for plural pronouns when entities are ontologically similar and connected by conjunctions like "and."
LLMs not only understand plural references but also mirror human preferences in pronoun usage based on entity similarity and conjunctions.
Coreference resolution is an important task in contextual reasoning. In this paper, we investigate the mechanism for representing and retrieving singular and plural entities for plural reference. We use a combination of mechanistic interpretability and attention pattern analysis to study the process in which LLMs predict a pronoun to refer back to previously mentioned entities. Using a range of causal intervention techniques, we find a set of attention heads that are responsible for (1) representing coreference information in the input, (2) identifying entities that form a plural reference, (3) transferring the information to the component that is responsible for selecting the antecedents and predicting the pronoun. We also find that LLMs align with humans in preference for plural pronoun. Specifically, entities in a plural construction are more likely to be referred to as a plural entity if they are ontologically similar and are linked by the conjunction"and".
