Search papers, labs, and topics across Lattice.
This paper introduces a dual-branch gated fusion framework that combines XLSR-53 with a novel 66-dimensional descriptor called CORES to improve the attribution of synthetic audio utterances to their originating systems. The method addresses the limitations of closed-set models by effectively capturing diverse synthesis artifacts across multiple dimensions, ensuring robust performance under both in-domain and out-of-domain conditions. The proposed approach achieves a remarkable 97.6% accuracy on the MLAAD benchmark, significantly outperforming existing methods by reducing the false positive rate by 83.5%.
Achieving 97.6% accuracy in audio deepfake attribution, this framework transforms how we tackle unseen synthesizers in open-set scenarios.
Attributing a synthetic utterance to its originating system remains an open challenge: closed-set models fail to reject unseen synthesizers and produce overconfident predictions. To address this, we propose a dual-branch gated fusion framework that pairs XLSR-53 with CORES, a 66-dimensional descriptor that, unlike prior Linear Filter Bank (LFB)-only work, spans cepstral, oscillatory, rhythmic, energy, and spectral dimensions to capture complementary synthesis artifacts. Our analysis shows XLSR-53 remains discriminative in-domain (ID) while CORES generalizes stably under distribution shift (OOD), yet their naive concatenation fails due to SSL representational imbalance. To resolve this, an input-conditioned gate adaptively weights each branch under joint training with cross-entropy, an energy margin loss for ID/OOD separation, and a gate diversity term. On the MLAAD benchmark, our system achieves 97.6\% ID accuracy, 4.9\% EERc, and an 83.5\% relative FPR95 reduction over the Interspeech 2025 baseline.
