Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study addresses the challenge of generating empathetic mental health counseling responses in low-resource languages by curating a dataset of 625 authentic mental health cases from diverse sources. Using this dataset, the authors develop the Role-Playing Reflective Chain-of-Thought Advisory Framework (RP-RCAF) to enhance the performance of three state-of-the-art LLMs in producing culturally sensitive and ethically aligned advice. The results demonstrate that RP-RCAF significantly improves the quality of generated responses, aligning them more closely with professional psychological counseling standards compared to conventional prompting methods.
LLMs can be guided to produce culturally sensitive mental health advice that rivals professional counseling through innovative human-LLM collaboration techniques.
Despite recent advances in large language models (LLMs), their ability to generate empathetic mental health counseling responses in low-resource languages remains largely unexplored. To address this gap, we curate 625 authentic mental health cases from three complementary sources: (1) publicly available Facebook posts discussing mental health concerns, (2) transcripts from the Bangladeshi television program "Ami Akhon Ki Korbo", and (3) anonymized student questionnaire responses covering diverse emotional and psychological challenges. Based on these cases, we build an evaluation corpus comprising advice written by licensed clinical psychologists and responses generated by three modern proprietary LLMs: GPT-4o Mini, Claude 4.5 Haiku, and Gemini 2.5 Pro. We further propose the Role-Playing Reflective Chain-of-Thought Advisory Framework (RP-RCAF), a task-specific prompting strategy that combines expert-authored few-shot examples with structured self-reflection to produce supportive, culturally aware, and ethically aligned counseling through a compassionate advisor persona. We also introduce the Grok 4-Based Response Evaluation and Scoring Framework (G-REFS), which integrates automated assessment with expert psychologist validation across emotional sensitivity, cultural appropriateness, linguistic clarity, and ethical soundness. Experimental results show that RP-RCAF consistently outperforms conventional prompting across all evaluated models and produces responses that more closely align with professional psychological counseling.