Search papers, labs, and topics across Lattice.
This paper introduces MG-RWKV, a multi-granularity framework designed for Temporal Forgery Localization (TFL) that addresses the limitations of existing methods by achieving efficient full-sequence processing with O(T) complexity. The framework incorporates a Bidirectional RWKV architecture for capturing temporal contexts, a Multi-Granularity Mixture of Experts for adaptive routing based on forgery duration, and Cross-Granularity Consistency to minimize false positives in authentic regions. Experimental results on Lav-DF, TVIL, and Psynd datasets show that MG-RWKV outperforms state-of-the-art methods while maintaining low computational costs.
MG-RWKV achieves state-of-the-art TFL performance with a groundbreaking O(T) complexity, redefining efficiency in audio-visual content authenticity verification.
Driven by Artificial Intelligence-Generated Content (AIGC), the authenticity of audio-visual content is facing severe challenges. Temporal Forgery Localization (TFL) aims to precisely identify manipulated segments within untrimmed sequences. However, existing methods are limited by CNNs' local receptive fields or Transformers' quadratic complexity, while emerging linear models often struggle to balance global authentic context compression with local abrupt forgery perception. To address this, we propose MG-RWKV, a multi-granularity framework that leverages the data-dependent state evolution of RWKV to achieve efficient full-sequence processing with O(T) complexity. Our framework features three core innovations: (1) a Bidirectional RWKV architecture that captures bidirectional temporal contexts without quadratic overhead; (2) a Multi-Granularity Mixture of Experts (MG-MoE) that performs dynamic routing over explicit temporal receptive fields, adaptively selecting granularities based on forgery duration to significantly enhance decision interpretability; and (3) Cross-Granularity Consistency (CGC), which aligns adjacent feature pyramid levels through hierarchical scale-wise pairing and spatial boundary-aware weighting, effectively reducing false positives in authentic regions. Extensive experiments on Lav-DF, TVIL, and Psynd datasets demonstrate that MG-RWKV achieves state-of-the-art performance with low computational cost.
Tsinghua AI