Search papers, labs, and topics across Lattice.
This paper introduces a multi-domain benchmark specifically designed to detect AI-generated text-rich images produced by GPT Image 2, encompassing 8,602 images across six categories such as commercial posters and receipts. The study evaluates five AI-generated image detectors in a zero-shot setting, revealing that their performance varies significantly across different domains, with even the best conventional detector showing vulnerability to JPEG compression artifacts. These findings underscore the necessity for detection methods that are sensitive to both textual content and layout organization in modern AI-generated imagery.
Detector performance varies dramatically across domains, with even top models struggling against JPEG compression, highlighting a critical gap in current methodologies.
Text-rich images often contain privacy-sensitive, transactional, or decision-relevant information. As recent multimodal image generation models become increasingly capable of synthesizing realistic textual content and structured visual designs, detecting AI-generated text-rich images has become an important challenge for digital trust and content authenticity. Existing benchmarks, however, largely focus on object-centric images and provide limited coverage of scenarios where textual semantics and layout organization are central. In this paper, we introduce a multi-domain benchmark for detecting text-rich images generated by OpenAI's GPT Image 2. The benchmark contains 8,602 images across six representative categories: commercial posters, infographics, academic posters, receipts, tables, and UI screenshots. Using this benchmark, we evaluate five representative AI-generated image detectors in a zero-shot setting and analyze their overall, category-wise, and post-processing robustness. Our results show that detector performance is highly domain-dependent: methods that perform well in some categories often fail on others, and even the strongest conventional detector exhibits severe sensitivity to JPEG compression. We further conduct an exploratory evaluation with a multimodal vision-language model, revealing both its promise and its limitations on structured formats. These findings highlight the need for text- and layout-aware detection methods for modern AI-generated images. Our dataset is released at XXX.
