Search papers, labs, and topics across Lattice.
The paper introduces TRACE, a training-free method for detecting partial audio deepfakes by analyzing the temporal dynamics of embeddings from frozen speech foundation models. TRACE leverages the hypothesis that genuine speech embeddings form smooth trajectories, while deepfake splices introduce abrupt disruptions. Evaluated on four benchmarks, TRACE achieves competitive or superior performance compared to supervised baselines, particularly on challenging LLM-generated deepfakes, demonstrating the effectiveness of temporal dynamics as a forensic signal.
Forget retraining: detecting audio deepfakes is as simple as spotting the "seams" in a speech foundation model's embedding trajectory.
Partial audio deepfakes, where synthesized segments are spliced into genuine recordings, are particularly deceptive because most of the audio remains authentic. Existing detectors are supervised: they require frame-level annotations, overfit to specific synthesis pipelines, and must be retrained as new generative models emerge. We argue that this supervision is unnecessary. We hypothesize that speech foundation models implicitly encode a forensic signal: genuine speech forms smooth, slowly varying embedding trajectories, while splice boundaries introduce abrupt disruptions in frame-level transitions. Building on this, we propose TRACE (Training-free Representation-based Audio Countermeasure via Embedding dynamics), a training-free framework that detects partial audio deepfakes by analyzing the first-order dynamics of frozen speech foundation model representations without any training, labeled data, or architectural modification. We evaluate TRACE on four benchmarks that span two languages using six speech foundation models. In PartialSpoof, TRACE achieves 8.08% EER, competitive with fine-tuned supervised baselines. In LlamaPartialSpoof, the most challenging benchmark featuring LLM-driven commercial synthesis, TRACE surpasses a supervised baseline outright (24.12% vs. 24.49% EER) without any target-domain data. These results show that temporal dynamics in speech foundation models provide an effective, generalize signal for training-free audio forensics.
