Search papers, labs, and topics across Lattice.
This paper introduces HumanForge, a comprehensive benchmark designed to evaluate human-centric video forgeries, addressing the limitations of existing datasets that neglect complex interactions and multi-modal alignment. The authors developed Gen2Anno, an innovative active multi-agent pipeline that automates the annotation process, producing over 18,000 high-fidelity video segments with detailed contrastive annotations. Benchmarking against state-of-the-art detectors and Large Multimodal Models reveals significant challenges in zero-shot generalization and fine-grained reasoning, underscoring the dataset's relevance in advancing digital content forensics.
HumanForge reveals that existing benchmarks fall short in capturing the complexities of human interactions in video forensics, exposing critical gaps in current detection capabilities.
Rapid advancements in video diffusion models and temporal editing tools have enabled the generation of highly realistic human-centric videos, posing unprecedented challenges to digital content forensics. Existing benchmarks primarily focus on either face-swapping or global text-to-video synthesis, overlooking the crucial dimensions of human-object or human-human interactions and multi-modal alignment. To address these limitations, we introduce HumanForge, a unified, large-scale, and multi-paradigm human-centric video forgery dataset. To construct and annotate this dataset without labor-intensive manual labeling or hallucinated monolithic prompts, we propose Gen2Anno, a modular active multi-agent pipeline built on LangGraph. Gen2Anno coordinates six specialized agents-ranging from source profiling to MoE-based reference analysis and closed-loop forensic verification-to generate over 18K high-fidelity video segments and produce structured, contrastive omni-annotations containing binary decisions, fine-grained artifact categories, and spatio-temporal localization. Extensive benchmarks using state-of-the-art traditional detectors and Large Multimodal Models (LMMs) demonstrate the significant challenges of zero-shot generalization and fine-grained reasoning on HumanForge. Code and dataset will be publicly released.
