Search papers, labs, and topics across Lattice.
This paper introduces SingFox, a large-scale dataset designed for evaluating singing deepfake detection and source tracing systems, comprising over 113,802 audio clips across 20 languages. The dataset is organized into six tracks that address various challenges, including language diversity and genre-specific music, enabling robust assessment of model performance in real-world scenarios. Experimental results indicate that models can achieve up to 77.84% accuracy in cross-dataset evaluations, underscoring the dataset's potential to enhance research reproducibility and effectiveness in this emerging field.
Achieving 77.84% accuracy in detecting singing deepfakes across diverse languages and genres reveals significant advancements in model robustness and evaluation.
In this work, we introduce SingFox, a comprehensive and large-scale dataset specifically designed to support robust evaluation of singing deepfake detection and source tracing systems. SingFox is divided into six distinct tracks (T1--T6), each targeting a unique form of novelty, ranging from language diversity (global and Indian) to genre-specific music and alternative fake generation methods. The dataset encompasses over 113,802 audio clips across 20 languages, totaling more than 126.32 hours of audio data and featuring 1,150 singers. Each track is designed to emulate real-world scenarios and evaluate how reliably models perform under different conditions, thereby assessing their robustness. SingFox aims to foster reproducibility and accelerate research in singing deepfake detection by providing a reliable benchmark for both the singfake detection task and the source verification task (model explainability). Experimental results show a highest accuracy of 77.84\% in cross-dataset evaluation settings. All code and resources required to reproduce the dataset are publicly available at https://github.com/Arth-Shah/SingFox.
