Search papers, labs, and topics across Lattice.
This paper introduces a method for personalizing fake news debunking messages by conditioning LLM generation on Big Five personality traits. A second LLM acts as an automated evaluator, simulating personality traits to assess the persuasiveness of personalized vs. generic debunking messages. Results indicate that personalized messages are generally more persuasive, with Openness increasing and Neuroticism decreasing persuadability, highlighting the potential of LLMs for targeted communication.
LLMs can generate more persuasive fake news debunking messages by tailoring them to specific personality traits, as evaluated by LLM-simulated personas.
This study proposes a novel methodology for generating personalized fake news debunking messages by prompting Large Language Models (LLMs) with persona-based inputs aligned to the Big Five personality traits: Extraversion, Agreeableness, Conscientiousness, Neuroticism, and Openness. Our approach guides LLMs to transform generic debunking content into personalized versions tailored to specific personality profiles. To assess the effectiveness of these transformations, we employ a separate LLM as an automated evaluator simulating corresponding personality traits, thereby eliminating the need for costly human evaluation panels. Our results show that personalized messages are generally seen as more persuasive than generic ones. We also find that traits like Openness tend to increase persuadability, while Neuroticism can lower it. Differences between LLM evaluators suggest that using multiple models provides a clearer picture. Overall, this work demonstrates a practical way to create more targeted debunking messages exploiting LLMs, while also raising important ethical questions about how such technology might be used.
