Track trials, findings, and clinical evidence as it lands.
Search papers, labs, and topics across Lattice.
The paper introduces AEGIS, a new benchmark for evaluating the forensic analysis of AI-generated academic images, addressing limitations in existing benchmarks through domain-specific complexity, diverse forgery simulations, and multi-dimensional forensic evaluation. AEGIS reveals that even advanced models like GPT-5.1 struggle (48.80% accuracy) and expert models show limited localization accuracy (IoU 30.09%) on academic image forensics. The benchmark evaluates 25 MLLMs, 9 expert models, and a unified multimodal model, highlighting complementary strengths across model families in detection, reasoning, and localization tasks.
Even GPT-5.1 struggles to distinguish AI-generated academic images from real ones, achieving only 48.8% accuracy, revealing a significant gap between generative and forensic AI capabilities.
We introduce AEGIS, A holistic benchmark for Evaluating forensic analysis of AI-Generated academic ImageS. Compared to existing benchmarks, AEGIS features three key advances: (1) Domain-Specific Complexity: covering seven academic categories with 39 fine-grained subtypes, exposing intrinsic forensic difficulty, where even GPT-5.1 reaches 48.80% overall performance and expert models achieve only limited localization accuracy (IoU 30.09%); (2) Diverse Forgery Simulations: modeling four prevalent academic forgery strategies across 25 generative models, with 11 yielding average forensic accuracy below 50%, showing that forensics lag behind generative advances; and (3) Multi-Dimensional Forensic Evaluation: jointly assessing detection, reasoning, and localization, revealing complementary strengths between model families, with multimodal large language models (MLLMs) at 84.74% accuracy in textual artifact recognition and expert detectors peaking at 79.54% accuracy in binary authenticity detection. By evaluating 25 leading MLLMs, nine expert models, and one unified multimodal understanding and generation model, AEGIS serves as a diagnostic testbed exposing fundamental limitations in academic image forensics.