Search papers, labs, and topics across Lattice.
This paper introduces an emotion-discriminative representation learning method aimed at enhancing zero-shot cross-lingual speech emotion recognition (SER) by addressing distribution mismatches and the absence of emotion annotations in target languages. By combining supervised contrastive learning to align emotions across languages with speaker adversarial learning to mitigate speaker-related biases, the authors achieve improved generalization in SER tasks. Experimental results show a significant performance boost compared to traditional training approaches, highlighting the effectiveness of their method in real-world applications.
Achieving a notable increase in zero-shot cross-lingual SER performance by aligning emotions while eliminating speaker biases could redefine how we approach multilingual emotion recognition.
Zero-shot cross-lingual speech emotion recognition (SER) remains challenging due to distribution mismatches across languages and the lack of emotion annotations in target language. Under such conditions, models trained solely on source-language data frequently suffer from degraded generalization when evaluated on unseen target languages. To address this limitation, we propose an emotion-discriminative representation learning method that integrates supervised contrastive learning and speaker adversarial learning. The contrastive learning promotes cross-lingual emotion alignment, while speaker adversarial learning suppresses speaker-related cues to encourage speaker-invariant representations. Experimental results under a zero-shot cross-lingual SER setting demonstrate that the proposed method significantly improves SER performance over conventional training strategies.
