Search papers, labs, and topics across Lattice.
This paper addresses the challenge of multimodal emotion-cause pair extraction (MECPE) by introducing Robust Pair Confidence Learning (RPCL), which enhances the reliability of pair confidence scores. By applying a confidence-difference margin constraint and aligning clean pair predictions with those from a corrupted context, RPCL effectively separates gold pairs from hard negatives. The method demonstrates significant improvements in Pair F1 and Pair AUPRC across multiple datasets, indicating that a more structured approach to pair confidence can enhance extraction performance.
RPCL reshapes how we approach pair confidence in MECPE, achieving up to 2.83 percentage points improvement in extraction accuracy.
Multimodal emotion-cause pair extraction (MECPE) requires reliable pair confidence over candidate pairs. Existing pair scorers commonly use pair-level cross entropy over valid candidates, which treats links mostly independently. This leaves the relative confidence geometry among competing causes under-constrained, allowing gold pairs to stay close to hard negatives or rely on incidental non-gold context. We study this vulnerability as pair-confidence brittleness and propose RPCL (Robust Pair Confidence Learning), a training-only framework for pair-confidence learning. RPCL encourages pair confidence to be both discriminative and stable: gold pairs are separated from row-wise hard negatives through a confidence-difference margin constraint, and clean pair predictions are aligned with predictions from a corrupted view where non-gold contextual utterance representations are partially corrupted. The original clean pair scorer and decoding pipeline are used unchanged at inference time. On ECF, MECAD, and MEC4, RPCL improves the three-seed mean Pair F1 over a matched base model by 2.58 to 2.83 percentage points in the full text-audio-video setting, and improves mean Pair AUPRC on all three datasets. Diagnostic analysis further shows larger gold-negative confidence gaps and lower margin-violation severity. These results suggest that explicitly shaping pair confidence is an effective training strategy for MECPE.
