Search papers, labs, and topics across Lattice.
The ProSarc framework introduces a novel approach to sarcasm detection using audio signals by modeling temporal prosodic incongruity, which captures the mismatch between local prosodic features and the overall emotional tone of an utterance. By employing dual encoding paths鈥擥lobal Emotion Encoder and Temporal Prosody Encoder鈥攁longside a Prosodic Incongruity Analyzer, the system effectively classifies sarcasm and provides uncertainty estimates through Monte Carlo dropout. ProSarc achieves superior performance over previous audio-only methods, with F1 scores of 75.3 on MUStARD++, 62.9 on spontaneous speech, and 65.6 on cross-lingual datasets, while also demonstrating alignment with human perception in sarcasm detection.
Sarcasm detection in audio is revolutionized by a framework that quantifies prosodic incongruity, achieving state-of-the-art performance across multiple datasets.
We present ProSarc, an audio-only framework that detects sarcasm by modelling temporal prosodic incongruity, that is, the mismatch between local prosodic dynamics and the utterance-level emotional baseline. Dual encoding paths, a Global Emotion Encoder and a Temporal Prosody Encoder (BiLSTM + multi-head attention), feed a Prosodic Incongruity Analyzer that produces a scalar incongruity score for classification. Monte Carlo dropout provides uncertainty estimates, and an attention-based mechanism localises sarcastic onset without frame-level labels. ProSarc outperforms prior audio-only methods on MUStARD++ (F1=75.3) and generalises to spontaneous (PodSarc, F1=62.9) and cross-lingual speech (MuSaG, F1=65.6). Ten-run validation confirms the contribution of incongruity modelling (Wilcoxon p=0.002, Cohen's d=1.51). Human evaluation shows that model uncertainty tracks perceptual ambiguity and predicted onsets align with human-annotated temporal windows.
