Search papers, labs, and topics across Lattice.
This paper introduces GRIDEX, a novel pipeline designed to generate structured forensic explanations for anomalies in deepfake spectrograms by identifying and analyzing the most diagnostic regions. By employing a two-stage learning paradigm that integrates supervised fine-tuning with Group Relative Policy Optimization, GRIDEX enhances artifact localization and the quality of explanations compared to existing vision-language model baselines. The framework not only highlights anomalous areas but also provides contextual acoustic interpretations, addressing a critical gap in the forensic analysis of deepfake audio.
GRIDEX transforms deepfake detection by providing clear, structured explanations of audio anomalies, making forensic analysis more efficient and reliable.
The advancement of speech generation technologies has made artificial speech increasingly realistic. Although modern classification models can achieve high accuracy when it comes to deepfake detection, they do not produce evidences such as indicating where spoof cues appear in the spectrogram and what they imply acoustically, limiting their usefulness in forensic settings. Manual analysis of full spectrograms is resource-intensive, so evidence should narrow attention to the most diagnostic regions. Moreover, existing explainability methods have limited capabilities in connecting contextual attributes to localized evidence, making explanations harder to verify. To overcome this limitation, we propose GRIDEX, a pipeline that, when given a deepfake spectrogram, generates forensic explanations of its anomalies. The pipeline (i) selects top-K anomalous regions in the spectrogram and (ii) produces an explanation for each anomaly. The explanations follow a schema of categorical acoustic fields, including temporal, spectral, phonetic information and interpretation text. To our knowledge, this is the first framework to generate structured forensic explanations using regional grounding for deepfake spectrograms. GRIDEX is trained with a two-stage learning paradigm that combines supervised fine-tuning (SFT) with Group Relative Policy Optimization (GRPO). Experiments on our dataset show improved artifact localization and explanation quality over strong vision-language model (VLM) baselines. The dataset and code will be released upon publication.
