Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
CF-Net is a novel deep multimodal network designed to recognize ambivalence and hesitancy in unconstrained video by integrating visual, audio, and transcript data while addressing the inherent ambiguity of the target signal. The model employs speaker normalization to mitigate identity leakage and utilizes a ConflictFusion module to analyze cross-modal incongruence, enhancing its ability to detect subtle cues of AH. Achieving a Macro F1 score of 0.7155 on the BAH validation set and 0.7364 on the private challenge test set, CF-Net demonstrates significant improvements in recognizing nuanced emotional states in video content.
CF-Net achieves state-of-the-art performance in recognizing ambivalence and hesitancy by effectively fusing multimodal data while addressing identity leakage.
Detecting ambivalence and hesitancy (AH) in unconstrained video is challenging because the target signal is inherently ambiguous and expressed through subtle cross-modal incongruence rather than prototypical affect. We present CF-Net, a deep multimodal network submitted to the 3rd Edition of the AH Video Recognition Challenge (ABAW 11th, ECCV 2026), targeting the BAH dataset. CF-Net encodes visual, audio, and transcript streams with frozen SigLIP2, HuBERT, and DistilBERT backbones, normalises backbone features per speaker to reduce identity leakage, and fuses them via a ConflictFusion module that explicitly computes pairwise cross-modal incongruence. Training combines certainty-weighted focal loss, manifold mixup, and modality dropout; an auxiliary certainty-regression head leverages ambiguity annotations to stabilise learning on genuinely borderline samples. CF-Net achieves a Macro F1 of 0.7155 on the BAH validation set and 0.7364 (AP = 0.7492) on the private challenge test set.