Search papers, labs, and topics across Lattice.
This paper introduces a novel approach to detecting AI-generated videos by leveraging noise amplification through bit-plane analysis, addressing a critical gap in distinguishing between authentic and AI-generated content. The authors propose a method that enhances noise signals at pixel, region, and frame levels, which is then utilized in discriminator networks for effective classification. Experimental results on the GenVidBench and the newly introduced HardGVD benchmark demonstrate that this method significantly outperforms existing state-of-the-art detection techniques.
Noise amplification reveals hidden artifacts in AI-generated videos, outperforming traditional detection methods by focusing on the nuances of noise rather than just visual content.
With the rapid advancement of video generation models, distinguishing between AI-generated and authentic videos has emerged as a challenging endeavor. The majority of existing research endeavors concentrate on the development of detectors for identifying samples generated by generative adversarial networks. Nevertheless, the detection of AI-generated videos, particularly those produced by text-to-video models, still remains an uncharted territory. Although state-of-the-art text-to-video models can generate realistic visual content similar to real videos, they fall short of generating the details of the images and the changes in details within the videos. Inspired by this, we address AI-generated video detection from a novel perspective of bit-planes, which can effectively describe the details or noises in images or videos. To this end, we propose a simple yet effective approach called Noise Amplification. This approach first extracts noise signals based on bit-planes, then amplifies these noise signals, and finally feeds them into the discriminator networks for video fake classification. Noise amplification is comprehensively constructed by incorporating three aspects: pixel-level intensity enhancement, region-level spatial amplification, and frame-level temporal aggregation. To evaluate methods of AI-generated video detection in challenging scenarios, we also introduce a benchmark named HardGVD. Extensive experiments on both the large-scale dataset GenVidBench and HardGVD show that our simple approach significantly outperforms state-of-the-art methods.
