Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper investigates how well LLMs can encode personality traits into generated life story narratives. They condition 10 different LLMs on real psychometric profiles from 290 participants to generate first-person narratives, then use 3 independent LLMs to predict the original personality scores from the generated text. The results show that personality scores can be recovered from the generated narratives with high reliability (r = 0.750), approaching human test-retest reliability, and that narrative content reflects personality-driven behavioral patterns observed in real human conversations.
LLMs can encode and decode personality traits in generated text so accurately that they nearly match human test-retest reliability, revealing a surprisingly robust understanding of individual differences.
Personality traits are richly encoded in natural language, and large language models (LLMs) trained on human text can simulate personality when conditioned on persona descriptions. However, existing evaluations rely predominantly on questionnaire self-report by the conditioned model, are limited in architectural diversity, and rarely use real human psychometric data. Without addressing these limitations, it remains unclear whether personality conditioning produces psychometrically informative representations of individual differences or merely superficial alignment with trait descriptors. To test how robustly LLMs can encode personality into extended text, we condition LLMs on real psychometric profiles from 290 participants to generate first-person life story narratives, and then task independent LLMs to recover personality scores from those narratives alone. We show that personality scores can be recovered from the generated narratives at levels approaching human test-retest reliability (mean r = 0.750, 85% of the human ceiling), and that recovery is robust across 10 LLM narrative generators and 3 LLM personality scorers spanning 6 providers. Decomposing systematic biases reveals that scoring models achieve their accuracy while counteracting alignment-induced defaults. Content analysis of the generated narratives shows that personality conditioning produces behaviourally differentiated text: nine of ten coded features correlate significantly with the same features in participants' real conversations, and personality-driven emotional reactivity patterns in narratives replicate in real conversational data. These findings provide evidence that the personality-language relationship captured during pretraining supports robust encoding and decoding of individual differences, including characteristic emotional variability patterns that replicate in real human behaviour.