Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper details a calibrated ensemble approach for recognizing ambivalence and hesitancy (A/H) in digital behavior-change interventions, utilizing a fusion of face, audio, text, and pose embeddings. The system achieved a macro-F1 score of 0.7358 on the public test set and demonstrated strong generalization to unseen data by scoring 0.7361 on the private test set with an identical configuration. The results underscore the effectiveness of the ensemble method in tackling the challenges posed by A/H recognition in diverse participant groups.
Achieving near-identical performance on unseen data highlights the robustness of our calibrated ensemble in recognizing ambivalence and hesitancy from multimodal inputs.
Ambivalence and hesitancy (A/H) undermine digital behaviour-change interventions, and recognizing them automatically from video is the goal of the ABAW A/H challenge on the BAH dataset. We describe our system for the 11th edition of the challenge: a calibrated, equal-weight ensemble of three fusion models over frozen face, audio, text, and pose embeddings, which reaches 0.7358 macro-F1 on the public test set. This year's private test, released on a disjoint set of 30 new participants, is scored on five allowed submissions; we report the configuration and rationale of each of our five submissions, and, where already available, the private-test score obtained. Our first submission, an exact replica of the calibrated ensemble tuned only on public validation, scored 0.7361 macro-F1 on the private test, matching our public-test estimate almost exactly and confirming the pipeline generalizes to unseen participants without leakage.