Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper critiques the traditional third-person audit approach to bias in large language models (LLMs) and introduces Situated Interaction Auditing (SIA), which focuses on how user profile signals influence model responses. By examining the interplay of implicit sociodemographic markers, writing style, and stated identity, the authors reveal that bias is not only about how models represent demographic groups but also how they interact with users. The case study demonstrates that user characteristics significantly affect the quality, content, and tone of LLM outputs, highlighting the need for a user-centered approach in bias research.
Bias in LLMs isn't just about how they describe others; it’s about how they respond to you, revealing a critical blind spot in existing audit methodologies.
Research on bias in large language models (LLMs) has predominantly focused on third-person audits, which study how models represent or evaluate demographic groups as external subjects. However, this paradigm overlooks a structural blind spot because the user is absent from the audit. In practice, LLMs are used in open-ended, personal interactions, during which the model implicitly represents the user and adjusts its responses accordingly. When identical requests yield different responses depending on who is asking, bias manifests not in how the model describes others but in how it treats its interlocutor. We propose Situated Interaction Auditing (SIA), a user-centered framework for studying how user profile signals -- implicit sociodemographic markers, writing style, and stated identity -- systematically shape LLM response quality, content, and tone. We demonstrate the framework through a case study that intersects gender and socioeconomic status signals across multiple task domains and outline a research agenda for SIA as a new mission for natural language processing.