Search papers, labs, and topics across Lattice.
The paper introduces EA-Swin, an Embedding-Agnostic Swin Transformer designed to detect AI-generated videos by directly modeling spatiotemporal dependencies on pretrained video embeddings using a factorized windowed attention mechanism. This approach overcomes limitations of existing methods that rely on shallow embedding trajectories or are computationally expensive. The authors also create the EA-Video dataset, a new benchmark with 130K videos, and demonstrate that EA-Swin achieves 0.97-0.99 accuracy across various generators, significantly outperforming state-of-the-art methods and generalizing well to unseen distributions.
Forget shallow embedding trajectories and computationally heavy MLLMs: EA-Swin's factorized windowed attention on pretrained video embeddings leaps ahead in detecting AI-generated videos, achieving 5-20% accuracy gains.
Recent advances in foundation video generators such as Sora2, Veo3, and other commercial systems have produced highly realistic synthetic videos, exposing the limitations of existing detection methods that rely on shallow embedding trajectories, image-based adaptation, or computationally heavy MLLMs. We propose EA-Swin, an Embedding-Agnostic Swin Transformer that models spatiotemporal dependencies directly on pretrained video embeddings via a factorized windowed attention design, making it compatible with generic ViT-style patch-based encoders. Alongside the model, we construct the EA-Video dataset, a benchmark dataset comprising 130K videos that integrates newly collected samples with curated existing datasets, covering diverse commercial and open-source generators and including unseen-generator splits for rigorous cross-distribution evaluation. Extensive experiments show that EA-Swin achieves 0.97-0.99 accuracy across major generators, outperforming prior SoTA methods (typically 0.8-0.9) by a margin of 5-20%, while maintaining strong generalization to unseen distributions, establishing a scalable and robust solution for modern AI-generated video detection.
