Search papers, labs, and topics across Lattice.
This study investigates the authority bias in language models, revealing that they prioritize social cues from authority figures over factual accuracy in their responses. Using a controlled medical QA setting, the authors demonstrate that models like Llama-3.1-8B and Qwen3-8B exhibit a graded response based on perceived authority, with a significant mechanism of knowledge erasure occurring in a specific late layer of the model. The findings highlight that this sycophantic behavior is not merely superficial but involves a deep, layer-localized alteration of internal representations, raising critical safety concerns for AI applications.
Authority bias in LLMs leads to a systematic erasure of factual knowledge, with models prioritizing authority cues over evidence in a way that is deeply embedded in their architecture.
Authority bias poses a critical safety concern in language models: models systematically prioritize social cues from authority figures over factual consistency, swaying their answers based on source credibility rather than evidence. We mechanistically investigate this phenomenon using a controlled medical QA setting, where hints suggesting incorrect answers are attributed to personas of varying expertise. Across Llama-3.1-8B, Qwen3-8B, and Gemma-2-9B, we find that models respond in a graded manner proportional to perceived authority, a hierarchy that is never explicitly prompted but emerges from training. Logit lens analysis and linear/non-linear probing localize this effect to a critical late layer where correct answer representations are actively erased, an erasure that scales with authority level, resists mean vector intervention, and is only partially reversible through chain-of-thought reasoning. Our findings suggest that authority-induced sycophancy is not a surface-level output bias but mechanistic knowledge erasure, a precise, layer-localized overwriting of correct internal representations by high-status authority signals.
