Search papers, labs, and topics across Lattice.
This study investigates the impact of gender-associated linguistic features in prompts on the responses generated by large language models (LLMs). It finds that prompts containing linguistic traits more commonly associated with women elicit shorter, less sophisticated, and less formal responses, a pattern that persists across multiple document types and models. The research highlights the entanglement of linguistic register with model representation, suggesting that mitigating these biases is complex due to their deep cultural embedding and early-layer encoding in transformers.
Gendered language in prompts can lead to significantly poorer responses from LLMs, revealing a hidden bias that affects workplace communication.
Professional communication is increasingly mediated by LLMs - but do these models serve all users equally? We show that when prompts contain linguistic features more commonly used by women (hedges, tag questions, collective reference), they systematically elicit shorter, less sophisticated, and less formal responses across three document types and four models. These effects persist after controlling for prompt complexity and feature carry-over. Explicit gender cues like sign-off names are encoded in the same representational space as linguistic dialect - suggesting shared underlying mechanisms - yet linguistic register is far more influential, producing large, consistent effects where names produce none. Our results further reveal that post-hoc mitigation is challenging: because these patterns are culturally embedded and outside conscious control, users cannot easily avoid them through strategic self-presentation, and mechanistic analysis reveals that linguistic features are encoded in early transformer layers and entangled with other features. Our work calls for upstream consideration of the influences of linguistic variation to mitigate disparate impacts of LLM-mediated workplace communication.
