Search papers, labs, and topics across Lattice.
This paper presents an on-device audio deepfake detection model that utilizes a truncated self-supervised learning backbone combined with a logistic classifier, addressing privacy concerns associated with cloud-based solutions. The proposed model not only enhances accuracy by outperforming the baseline AASIST by 10% but also improves inference speed by 40%. Integrated into a browser plugin, this innovative approach provides journalists and fact-checkers with a fast and secure tool for verifying audio authenticity.
A lightweight audio deepfake detection tool that outperforms existing models while preserving user privacy by operating entirely on-device.
Audio deepfakes are a growing challenge for the general public, as well as for journalists and fact-checkers. The latter need reliable tools to verify the authenticity of their sources, while at the same time keeping their information private. Commercial deepfake detection solutions rely on cloud-based processing, which raises privacy concerns. To solve this problem, we propose an on-device audio deepfake detection model. We show that a truncated self-supervised backbone with a simple logistic classifier is both very fast and often more accurate than existing solutions. Our solution outperforms the baseline AASIST by 10% and improves inference speed by 40%. We integrate this model into a browser plug-in, which allows journalists and fact-checkers to detect deepfakes easily and securely. Code for the plugin is available at https://github.com/OctavianPascu97/Audio-Deepfakes-Browser-Plugin.
