Search papers, labs, and topics across Lattice.
This study introduces a multimodal application that integrates augmented reality and a large language model (LLM) to facilitate self-attachment psychotherapy through the Self-Initiated Humour Protocol (SIHP). An eight-day user study with 16 participants demonstrated significant improvements in self-reported mood, highlighting the effectiveness of customizable 3D childhood avatars and emotion mirroring features in enhancing emotional connection. Key findings reveal that while emotion mirroring increases engagement, its success is contingent on the accuracy of emotion classification and the intensity of avatar animations.
Personalized 3D avatars and LLM-driven therapists can significantly enhance emotional bonding in digital mental health interventions.
The growing global demand for mental health support increasingly exceeds the supply of qualified practitioners, creating an urgent need for scalable digital interventions that can deliver meaningful emotional connection. In response, we present a novel multimodal application that operationalises the Self-Initiated Humour Protocol (SIHP) within a Self-Attachment Technique (SAT) framework. Our mobile application integrates customisable 3D childhood avatars, augmented reality, and an LLM-driven virtual therapist capable of automated emotion mirroring. An eight-day user study (N=16) indicates the system's feasibility and improvements in self-reported mood. Results show that personalised avatars and text-to-speech output strengthen emotional bonding and perceived empathy. Although emotion mirroring boosts engagement, its effectiveness depends heavily on classification accuracy and animation intensity. Moreover, findings indicate a shift in user expectations--from reactive chatbots to proactive conversational facilitators. We conclude with design implications for leveraging AI and AR to cultivate embodied empathy in digital mental health tools.
NUS