Search papers, labs, and topics across Lattice.
This paper introduces Cognitive Relative Policy Optimization (CRPO), a novel reinforcement learning framework specifically designed to enhance large language model (LLM) reasoning in mental health assessments. By integrating stage-dependent uncertainty modeling and a stage-wise entropy regularization mechanism, CRPO mimics human cognitive processes, transitioning from broad exploration to confident decision-making. Experimental results across eight mental health datasets reveal that CRPO improves weighted F1-scores by an average of 10.4 percentage points compared to existing reinforcement learning baselines, demonstrating its effectiveness in reasoning-intensive scenarios.
CRPO not only aligns LLM reasoning with human cognitive processes but also boosts performance in mental health assessments by over 10 percentage points.
Mental health problems such as anxiety, depression, and suicide remain urgent global challenges, where timely and accurate assessment is critical for effective intervention. Recently, large language models have been explored for mental health assessment. However, existing general-purpose post-training methods do not align with the cognitive processes of human assessment, which may lead to unreliable reasoning outcomes. To bridge this gap, we propose Cognitive Relative Policy Optimization (CRPO), a reinforcement learning framework tailored for the mental health domain. CRPO extends group relative policy optimization by integrating stage-dependent uncertainty modeling into the policy optimization process. Specifically, we introduce a stage-wise entropy regularization mechanism that encourages broad exploration in early reasoning phases and progressively enforces confident decision-making in later stages, mimicking the human cognitive shift from uncertainty to certainty. In addition, inspired by cognitive appraisal theory, we formalize cognitive reasoning stages, thereby guiding theory-grounded interpretable inference. Experiments on 8 mental health datasets show that CRPO achieves an average improvement of 10.4 percentage points in weighted F1-score over the best reinforcement learning baseline. Furthermore, the CRPO-trained model Mental-R1 demonstrates clear advantages compared with existing large language models on reasoning-intensive cases, suggesting that CRPO enhances reasoning capabilities for mental health assessment.
