Search papers, labs, and topics across Lattice.
This study investigates the effectiveness of voiced and unvoiced speech regions in detecting audio deepfakes, utilizing a measure of signal periodicity to analyze these components. By training a graph attention-based AASIST detection system independently on voiced and unvoiced segments, the research reveals that unvoiced regions significantly enhance detection accuracy, achieving an equal error rate (EER) of 6.62%. Furthermore, combining both regions through score-level fusion leads to an overall performance improvement, resulting in a 5.82% EER, which represents a 49% enhancement over the baseline model that utilizes the entire audio signal.
Unvoiced speech regions boost deepfake detection accuracy by nearly 50%, outperforming traditional full-audio approaches.
Deep neural network based deepfake detection systems have achieved high levels of accuracy on benchmark datasets and competitions. However, most models lack interpretability. It is challenging to extract reasoning from the network that can convince the human evaluator to trust the decision. Humans often rely on acoustic cues like unnatural pitch jitter, robotic intonation, acoustic artifacts, and unnatural sounding fricatives to judge the quality of the synthetic audio. This study explores the role played by the voiced and unvoiced regions of speech in discriminating synthetic from bonafide speech. A measure of signal periodicity is used to analyze speech into voiced and unvoiced components. Then, the graph attention based AASIST detection system is trained independently on each component. This work compares the accuracy of deepfake detection system using voiced and unvoiced components and analyzes the results on the MLAAD dataset. Our results show that unvoiced regions are particularly more effective in distinguishing synthetic (deepfake) speech from bonafide, and achieves an equal error rate of 6.62%. When combined with voice regions through score-level fusion, the overall performance improves further, yielding a 5.82% EER, a relative improvement of 49% over the baseline system that uses the full audio.
