Search papers, labs, and topics across Lattice.
This paper introduces a metric learning framework utilizing Proxy-Anchor loss to enhance TTS source attribution and out-of-distribution detection, particularly in open-set scenarios where unknown systems are present. By leveraging Wav2Vec2-BERT embeddings and an innovative architecture merging strategy, the proposed method achieves a remarkable 99.76% accuracy on in-distribution classes and significantly reduces the false positive rate for OOD detection. The findings indicate that this approach not only outperforms existing methods but also establishes a robust foundation for forensic analysis of synthetic speech across diverse TTS systems and languages.
Achieving 99.76% accuracy in TTS source attribution, this framework redefines the standards for audio forensics in the era of deepfake audio.
The proliferation of text-to-speech (TTS) systems capable of generating realistic synthetic speech poses growing challenges for audio forensics. While binary deepfake detection has received considerable attention, source tracing (i.e., identifying which TTS system produced a given audio sample) remains underexplored, particularly in open-set scenarios where unknown systems may be encountered. We propose a metric learning framework based on the Proxy-Anchor loss function that operates on Wav2Vec2-BERT embeddings to learn a discriminative embedding space for TTS source attribution and out-of-distribution (OOD) detection of unseen systems. We evaluate it on the MLAAD v9 dataset spanning 140 TTS systems across 51 languages, and introduce an architecture merging strategy that groups TTS system versions into unified classes, reducing inter-class confusion. Our system achieves 99.76% accuracy on 110 in-distribution classes and a False Positive Rate (FPR@95) as low as 2.04% for OOD detection. Also, for a fair comparison against the current state of the art, we further evaluate it on the MLAAD v5 official dataset splits, improving the OOD accuracy by almost doubling it. These results demonstrate that Proxy-Anchor metric learning, combined with architecture-aware class design and post-hoc OOD scoring, provides an effective framework for forensic TTS source tracing in both closed-set and open-set settings.
