Search papers, labs, and topics across Lattice.
The paper introduces Proteus, an automated framework for testing the robustness of audio deepfake detectors by systematically exploring various audio transformations. By employing both breadth-first search and a Q-learning agent, Proteus identifies effective augmentation combinations that can deceive the detector while maintaining speech quality. Continuous deployment of this framework revealed that certain augmentation chains can consistently alter detection outcomes, leading to improvements in the detector's resilience through targeted retraining.
Specific audio transformations can fool deepfake detectors while preserving intelligibility, revealing vulnerabilities that can be exploited for targeted retraining.
We present Proteus, a framework developed at Resemble AI for automated robustness testing of our audio deepfake detection system. Given a detector, Proteus systematically searches over sequences of everyday audio transformations (codec transcoding, additive noise, reverberation, dynamic-range compression, and VoIP simulation) to find combinations that fool the detector while preserving speech quality. We propose two complementary search strategies: (1) a breadth-first search that exhaustively maps augmentation effectiveness across the parameter space, and (2) a Q-learning agent designed to efficiently discover deeper attack chains by exploiting structural patterns in the BFS data. We report findings from continuous deployment of Proteus against our production detector, showing that specific augmentation chains can reliably flip detection verdicts while preserving speech intelligibility and speaker identity. We discuss how these findings are used to harden the detector through targeted retraining.
