Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
MyMentorLLM is a multimodal simulation environment designed for the deliberate practice of psychotherapy, generating 2,100 Cognitive Behavioural Therapy (CBT) training sessions involving simulated patients with specific mental health disorders. The study found that while most language models overestimated trainee competencies, the native speech-to-speech model provided the most accurate assessments, and feedback from supervisors significantly improved diagnostic accuracy in simulated psychotherapists. This work highlights the potential for scalable, structured training in psychotherapy, though it also raises concerns about patient fidelity and the calibration of supervisor feedback.
Trainee therapists using MyMentorLLM improved their diagnostic accuracy significantly with expert feedback, revealing the potential for AI to enhance psychotherapy training at scale.
Psychotherapists need repeated training and supervision by experts; however, scalability is problematic. Here we present MyMentorLLM, a multimodal voice- and text-based simulation environment for deliberate practice, used to generate 2,100 complete Cognitive Behavioural Therapy (CBT) training sessions. Each session links a DSM-5-TR-grounded patient (with major depressive, generalised anxiety or borderline personality disorder), a therapist-in-training and an expert supervisor. As an initial implementation, we adopted CBT because its structured procedures and competency-based supervision facilitate standardised simulation and evaluation. Sessions were analysed for emotional dynamics, therapeutic competence and diagnostic accuracy. Simulated patients expressed disorder-congruent emotional profiles, which trainee therapists mirrored as in real human counselling. The quality of supervision differed across LLMs: while most models overestimated trainees'competences, native speech-to-speech was closest to human scores. Supervisors'feedback led to better diagnoses in simulated psychotherapists in 5 out of 7 LLMs, and symptom identification accuracy increased with model size. This work shows that simulation of deliberate practice is possible for CBT training, although patient fidelity, calibration of supervisors, and harmful feedback should be evaluated together.