Track manipulation, locomotion and embodied systems.
Search papers, labs, and topics across Lattice.
Addressing the lack of spatially grounded semantic explanations in forensic media verification, the authors develop DF-CBM, an interpretable deepfake detector that roots manipulation concepts in specific facial regions. The architecture predicts a vocabulary of textual artifact concepts via concept-specific masked attention over parsed facial segments, passing these predictions through a strict bottleneck for the final classification. Crucially, DF-CBM matches state-of-the-art black-box detector performance while enabling verifiable counterfactual interventions that isolate the exact cues driving a prediction.
Interpretable deepfake detection no longer demands an accuracy penalty: grounding semantic artifact vocabularies in explicit facial regions matches black-box detection performance while enabling actionable counterfactual audits.
Deepfake detection methods have become increasingly effective yet most provide limited insight into the evidence behind their predictions. However, in forensic settings users also need to know which manipulation cues support the decision and where they appear. Existing explainability methods only partially address this need since localization-based approaches lack semantic descriptions while language-based explanation methods are only weakly grounded in visual evidence. In this work, we propose DF-CBM, a region-aware concept bottleneck model for explainable deepfake detection. DF-CBM builds a compact vocabulary of manipulation-related concepts from textual artifact annotations and links each concept to plausible facial and boundary regions. It then predicts these concepts from visual features using a concept-specific masked attention mechanism guided by parsed facial masks and the final real/fake decision is made from the predicted concept bottleneck. Our experiments show that DF-CBM outperforms concept-based baselines in concept prediction and deepfake classification while remaining competitive with state-of-the-art black-box detectors. Finally, qualitative results and intervention analyses demonstrate that DF-CBM provides spatially grounded concept evidence and enables counterfactual explanations of how individual manipulation concepts influence the final prediction. Our code is available at: https://github.com/GeorgeTsoumplekas/DF-CBM.