Search papers, labs, and topics across Lattice.
This paper addresses the underexplored area of emotional validation in dialogue systems by introducing a comprehensive framework that includes response identification, timing detection, and response generation. The authors present M-EDESConv, a 120k multilingual corpus, and MEGUMI, a novel emotion-aware model that integrates multilingual semantics with emotion-specific encoders, demonstrating superior performance on validation tasks. Key findings reveal that while current LLMs can generate diverse validating responses, they still struggle with deep emotional understanding, highlighting a critical gap in their capabilities.
Current LLMs may produce varied validating responses, but they fundamentally lack true emotional understanding, revealing a significant gap in dialogue system performance.
Emotional validation - explicitly acknowledging that a user's feelings make sense - has proven therapeutic value but has received little computational attention. Emotional validation in dialogue systems can be decomposed into (i) validating response identification, (ii) validation timing detection, and (iii) validating response generation. To support research on all three subtasks, we release M-EDESConv, a 120k English-Japanese multilingual corpus created through hybrid manual and automatic annotation, and M-TESC, a multilingual spoken-dialogue test set. For timing detection, we propose MEGUMI, a Multilingual Emotion-aware Gated Unit for Mutual Integration, that fuses frozen XLM-RoBERTa semantics with language-specific emotion encoders via cross-modal attention and gated fusion. MEGUMI shows superior performance on both the M-EDESConv and M-TESC datasets, both objectively and subjectively. Finally, our EmoValidBench benchmarks of GPT-4.1 Nano and Llama-3.1 8B indicate that current LLMs generate contextually similar and diverse validating responses, but emotional understanding remains a major area for improvement. Project page: https://github.com/zihaurpang/Multilingual-Emotional-Validation
