Search papers, labs, and topics across Lattice.
This study fine-tunes a Qwen3.5-27B model to predict depression severity scores from AI-generated mental health dialogue, addressing the challenge of low completion rates for traditional self-report measures like the PHQ-9. By leveraging a combination of ground-truth labels and pseudolabels from a reasoning model, the researchers created a robust dataset of 6,283 users, achieving significant predictive accuracy with a MAE of 2.6 and AUC of 0.91 at the clinical threshold. The findings demonstrate the potential for passive monitoring of depression severity, which could enhance early detection and intervention strategies in mental health care.
Predicting depression severity from AI dialogue can achieve clinical-level accuracy without requiring users to fill out traditional self-report questionnaires.
Depression is the leading cause of disability worldwide, and early detection of symptom change is essential for timely intervention. Validated instruments such as the Patient Health Questionnaire-9 (PHQ-9) support symptom monitoring at scale, but real-world completion rates are low, introducing response bias and systematic missingness. Passive approaches that infer severity from routinely generated data could close this gap. We address this by predicting PHQ-9 total scores directly from transcripts of conversations between users and an AI mental health application, requiring only conversation text and no additional clinical data. We fine-tune a Qwen3.5-27B backbone with a regression head, augment 3,111 ground-truth labels with pseudolabels generated by a reasoning model (Claude Opus) and iteratively trained intermediate models, for a combined dataset of 6,283 users. On a held-out test set of 842 users, our best model achieves MAE = 2.6, RMSE = 4.0, Pearson r = 0.80, and AUC = 0.91 at the PHQ-9 >= 10 clinical threshold. We also find AUC > 0.87 at every severity threshold from PHQ-9 >= 3 to PHQ-9 >= 24, demonstrating that the model captures depression severity across the full clinical spectrum. This work opens the door to passive, continuous symptom monitoring in AI mental health platforms, without requiring users to complete self-report measures.
