Search papers, labs, and topics across Lattice.
This study introduces TSJ (Theater-Stage-Judge), a longitudinal framework designed to evaluate cognitive-developmental risks in AI companions through extended user interactions. By simulating 12,960 person-days across various developmental stages and psychological vulnerabilities, the research reveals that traditional short-session evaluations significantly underestimate risks, particularly highlighting early childhood and emerging adulthood as critical periods of vulnerability. Key findings indicate that stable risk assessments require at least 140 interaction turns, with cognitive trust and emotional dependency identified as the most concerning risk dimensions.
Short-session tests miss critical developmental risks in AI companions, with stable evaluations only emerging after 140 interaction turns.
AI companions powered by large language models increasingly interact with cognition-developing users, including children and adolescents, creating risks that may accumulate over time. Existing safety evaluations largely rely on single-turn or short-session tests, which cannot capture risks that emerge only through prolonged interaction. To address this gap, we propose TSJ (Theater-Stage-Judge), a longitudinal framework combining persona-driven user simulation, dynamic psychological-state updating and retrospective evaluation. We evaluate six mainstream models across four developmental stages, twenty-four risk dimensions and three psychological-vulnerability personas, covering 12,960 simulated person-day interactions. TSJ shows that short-horizon testing systematically underestimates developmental risks, for which TSJ yields a stable risk estimate only after 140 turns within prolonged simulated relationships. Applying TSJ further identifies early childhood and emerging adulthood as the most vulnerable stages, with cognitive trust and emotional dependency as the weakest domains. TSJ provides a scalable methodology for longitudinal cognitive developmental risk evaluation in AI companion systems.
