Search papers, labs, and topics across Lattice.
The paper introduces C-ReD, a new Chinese benchmark dataset for detecting AI-generated text, designed to overcome limitations in existing datasets regarding model diversity and data homogeneity. C-ReD is constructed using real-world prompts and a diverse set of LLMs to generate text, enabling more robust detection capabilities. Experiments show that C-ReD facilitates both reliable in-domain detection and strong generalization to unseen LLMs and external Chinese datasets.
Current Chinese AI-generated text detection benchmarks are too homogeneous; C-ReD fixes this with real-world prompts and diverse LLMs, enabling better generalization.
Recently, large language models (LLMs) are capable of generating highly fluent textual content. While they offer significant convenience to humans, they also introduce various risks, like phishing and academic dishonesty. Numerous research efforts have been dedicated to developing algorithms for detecting AI-generated text and constructing relevant datasets. However, in the domain of Chinese corpora, challenges remain, including limited model diversity and data homogeneity. To address these issues, we propose C-ReD: a comprehensive Chinese Real-prompt AI-generated Detection benchmark. Experiments demonstrate that C-ReD not only enables reliable in-domain detection but also supports strong generalization to unseen LLMs and external Chinese datasets-addressing critical gaps in model diversity, domain coverage, and prompt realism that have limited prior Chinese detection benchmarks. We release our resources at https://github.com/HeraldofLight/C-ReD.
Tsinghua AI