Search papers, labs, and topics across Lattice.
This paper investigates the impact of Bonafide Resource (BR) and AI-based Generator (AG) diversity on the generalization of deepfake speech detection (DSD) models. They establish a baseline DSD model and conduct experiments to analyze how BR and AG factors influence the detection threshold. Based on these findings, they curate a balanced dataset and demonstrate that training on this dataset leads to improved cross-dataset generalization performance, highlighting the importance of balanced BR and AG representation for robust DSD.
Balancing the diversity of real and AI-generated speech data is the key to building deepfake detectors that actually generalize.
In this paper, we analyze two main factors of Bonafide Resource (BR) or AI-based Generator (AG) which affect the performance and the generality of a Deepfake Speech Detection (DSD) model. To this end, we first propose a deep-learning based model, referred to as the baseline. Then, we conducted experiments on the baseline by which we indicate how Bonafide Resource (BR) and AI-based Generator (AG) factors affect the threshold score used to detect fake or bonafide input audio in the inference process. Given the experimental results, a dataset, which re-uses public Deepfake Speech Detection (DSD) datasets and shows a balance between Bonafide Resource (BR) or AI-based Generator (AG), is proposed. We then train various deep-learning based models on the proposed dataset and conduct cross-dataset evaluation on different benchmark datasets. The cross-dataset evaluation results prove that the balance of Bonafide Resources (BR) and AI-based Generators (AG) is the key factor to train and achieve a general Deepfake Speech Detection (DSD) model.
