Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper investigates the impact of activation-based persona steering on LLMs in educational contexts, specifically short-answer generation and automated scoring. The study uses persona vectors representing seven character traits and evaluates their effects on the ASAP-SAS benchmark across three models. The key finding is that persona steering generally reduces answer quality, particularly for open-ended ELA prompts, and introduces valence-aligned calibration shifts in automated scoring, with Mixture-of-Experts models showing greater sensitivity.
Steering LLMs with persona vectors for education backfires: answer quality tanks, especially on subjective tasks, and automated scoring becomes wildly inconsistent.
Activation-based steering can personalize large language models at inference time, but its effects in educational settings remain unclear. We study persona vectors for seven character traits in short-answer generation and automated scoring on the ASAP-SAS benchmark across three models spanning two architectures. Persona steering lowers answer quality overall, with much larger effects on open-ended English Language Arts (ELA) prompts than on factual science prompts; interpretive and argumentative tasks are up to 11x more sensitive. On the scoring side, we observe predictable valence-aligned calibration shifts: evil and impolite scorers grade more harshly, while good and optimistic scorers grade more leniently. ELA tasks are 2.5-3x more susceptible to scorer personalization than science tasks, and the Mixture-of-Experts model shows roughly 6x larger calibration shifts than the dense models. To our knowledge, this is the first study to systematically examine the effects of activation-steered persona traits in educational generation and scoring, and the results highlight the need for task-aware and architecture-aware calibration when deploying steered models in educational settings.