Search papers, labs, and topics across Lattice.
This paper addresses the challenge of detecting hateful videos by introducing an explainable detection framework that provides contextual rationales for its judgments. The authors present two new datasets, Ex-HateMM and Ex-ImpliHateVid, which include detailed annotations of multimodal harmful elements and the reasoning behind classifications. Their proposed Information Augmentation and Reasoning Enhancement (IARE) framework significantly improves model explainability and achieves state-of-the-art performance in hateful video detection while generating coherent justifications for its decisions.
Explainable detection of hateful videos is now possible, revealing the nuanced reasoning behind classifications that traditional methods overlook.
Hateful videos have become prevalent on online platforms, highlighting an urgent need for effective detection. However, existing studies primarily focus on binary classification and fail to provide contextual rationales that reveal the implicit meanings behind these judgments, significantly undermining model explainability. To fill this gap, we aim to achieve explainable hateful video detection, enabling models to provide contextual rationales that integrate relevant evidence and logical reasoning alongside decisions. This approach can comprehensively enhance the understanding of video content and the explainability of the decision-making process. We first introduce two datasets, Ex-HateMM and Ex-ImpliHateVid, for explainable hateful video detection. Each dataset provides fine-grained annotations of multimodal harmful elements, along with contextual rationales. We then propose an Information Augmentation and Reasoning Enhancement (IARE) framework designed for explainable detection. The framework employs an information augmentation phase that leverages the multimodal chain-of-thought to integrate harmful elements, thereby enriching rationale evidence. Additionally, IARE incorporates a reasoning enhancement phase, in which Direct Preference Optimization guides the model toward correct reasoning paths and away from incorrect ones, thereby improving the logical coherence of its justifications. We conduct extensive experiments on the two datasets, comparing multiple baselines with our proposed IARE framework. The results demonstrate that IARE achieves state-of-the-art performance while also generating accurate rationales.
