Search papers, labs, and topics across Lattice.
This paper introduces a training-free explanation framework that combines explainable AI (XAI) evidence with multimodal large language models (LLMs) to enhance the interpretability of speech deepfake detection (SDD) systems. By constructing a grounded explanation dataset from the PartialSpoof dataset, the authors demonstrate that integrating XAI significantly improves the accuracy of generated explanations by over 45%, as validated through human evaluations and faithfulness checks. This advancement addresses the critical need for trustworthy, understandable explanations in SDD, which are essential for reliable decision-making in real-world applications.
Grounded explanations for speech deepfake detection can boost accuracy by over 45%, transforming how we interpret AI decisions in this critical domain.
Speech deepfake detection (SDD) systems require trustworthy explanations for reliable decision-making. Existing explanation ways mainly fall into two categories. Traditional explainable AI (XAI), such as gradient-based attribution, produces low-level attribution signals tightly coupled with model decisions, and harder to be understood by human than natural language explanations. Meanwhile, large language model (LLM)-based explanation generation often produces generic and ungrounded descriptions due to the lack of heuristic evidence and task-specific supervision, stemming from limited grounded explanation datasets for SDD. We therefore propose a training-free explanation framework that integrates XAI evidence with multimodal LLMs to generate grounded and specific explanations. Using the PartialSpoof dataset, we construct a grounded explanation dataset and show that methods with XAI increase inside accuracy by over 45\%, verified through human evaluation and faithfulness checks.