Search papers, labs, and topics across Lattice.
This study investigates the impact of role-playing historical personas on the internal beliefs of language models, specifically examining how such persona adoption influences the truthfulness of their outputs. Using linear truth probes, the authors find that while role-playing alters what models assert, it does not significantly change their internal representations of truth, as evidenced by the models' tendency to classify era-believed statements as false. In contrast, models exhibiting Emergent Misalignment show a more substantial shift in internal representation, suggesting a spectrum of belief internalization influenced by the nature of the task at hand.
Role-playing historical figures leads language models to assert false claims while maintaining a consistent internal representation of truth, revealing a nuanced spectrum of belief internalization.
Language models can state that "the Earth orbits the Sun" and, when role-playing Aristotle, assert the opposite. Recent work argues that persona adoption is fundamental to how language models operate, with models constantly selecting the most appropriate persona for a given context. Does such role-playing merely change the model's outputs, or does it also affect what the model internally represents as truthful? We study this question with linear truth probes, applying them to LLMs role-playing historical personas whose likely beliefs differ from modern consensus. For each persona, we compare false claims the persona would likely have endorsed (*era-believed*) with topic-matched false claims they would not have endorsed (*era-false*). Across prompting, in-context learning, and supervised fine-tuning, persona induction suppresses era-believed statements less than equally false alternatives, yet they remain classified as false overall. Role-play therefore shifts what these models say more than what they internally represent as true. We contrast this with models trained on harmful advice that exhibit Emergent Misalignment (EM). Across three model families (Qwen 2.5 14B, Qwen 3 8B, and Llama 3.3 70B), their false claims move substantially toward the true region of probe space, are defended under challenge roughly half the time versus about a sixth for role-play, and are used in downstream reasoning. Role-play and Emergent Misalignment thus are points on a spectrum of belief internalization, where role-play changes what a model says with little representational change, while Emergent Misalignment shifts the internal representation of false claims without fully marking them as true.
