Search papers, labs, and topics across Lattice.
This paper introduces UniGenDet, a unified framework for co-evolutionary image generation and generated image detection, aiming to bridge the architectural gap between generative and discriminative models. The framework employs a symbiotic multimodal self-attention mechanism and a unified fine-tuning algorithm to enable mutual improvement between the generator and detector. Experiments across multiple datasets demonstrate state-of-the-art performance in both image generation and detection tasks.
By unifying generative and discriminative models, UniGenDet achieves state-of-the-art image generation and detection, proving that the best fakes are made with a deep understanding of what makes them detectable.
In recent years, significant progress has been made in both image generation and generated image detection. Despite their rapid, yet largely independent, development, these two fields have evolved distinct architectural paradigms: the former predominantly relies on generative networks, while the latter favors discriminative frameworks. A recent trend in both domains is the use of adversarial information to enhance performance, revealing potential for synergy. However, the significant architectural divergence between them presents considerable challenges. Departing from previous approaches, we propose UniGenDet: a Unified generative-discriminative framework for co-evolutionary image Generation and generated image Detection. To bridge the task gap, we design a symbiotic multimodal self-attention mechanism and a unified fine-tuning algorithm. This synergy allows the generation task to improve the interpretability of authenticity identification, while authenticity criteria guide the creation of higher-fidelity images. Furthermore, we introduce a detector-informed generative alignment mechanism to facilitate seamless information exchange. Extensive experiments on multiple datasets demonstrate that our method achieves state-of-the-art performance. Code: \href{https://github.com/Zhangyr2022/UniGenDet}{https://github.com/Zhangyr2022/UniGenDet}.
Tsinghua AI