Search papers, labs, and topics across Lattice.
This paper introduces DAV-Det, a novel audio-visual AIGC detection system that decouples the analysis of audio and visual modalities to enhance forgery detection. By challenging the conventional assumption of cross-modal correspondence, the authors demonstrate that decision-level fusion outperforms feature-level fusion in identifying inconsistencies in generative audio-visual content. Their approach, which incorporates multi-granularity visual representations and a dual-branch audio architecture, achieved the highest score in the General AIGC Audio-Video Detection Challenge, highlighting its effectiveness in real-world scenarios.
Decision-level fusion outperforms traditional feature-level methods in detecting audio-visual forgeries, revealing a critical flaw in existing assumptions about modality correspondence.
Generative AI has rapidly expanded audio-visual forgery beyond human-centric deepfakes into general scenes. Existing AIGC detection methods assume audio-visual content correspondence, identifying forgeries by spotting cross-modal inconsistencies. However, we empirically find that this assumption does not consistently hold in general scenarios. We argue that, for general audio-visual AIGC detection, decision-level fusion is a more robust alternative to feature-level fusion. Therefore, we propose DAV-Det, a decoupled audio-visual AIGC detection system that independently models forensic evidence from each modality. The visual detector leverages multi-granularity representations at global, patch, and segment levels to capture spatial forgery cues, while the audio detector exploits both temporal and spectral irregularities via a gated temporal-spectral dual-branch architecture to model acoustic artifacts. Our method ranks 1st in the General AIGC Audio-Video Detection Challenge of the IJCAI-ECAI 2026 DDL 2.0 Workshop, with a final score of 0.8460. Code is available at https://github.com/tuffy-studio/DAV-Det.
