Search papers, labs, and topics across Lattice.
This study introduces the Triospect Detection Framework, which enhances AI-generated text detection by integrating three-dimensional perspectives of content and expression to counteract diverse textual manipulation attacks. The framework was rigorously tested across 17 different attack types, 12 domains, and 17 source models, showing substantial improvements over existing methods, with a 22.3% increase in AUROC and a 13% boost in TPR01 on the Humanize-16K dataset. These results highlight Triospect's robustness and reliability in real-world applications, marking a significant advancement in the field of statistical AI detection methods.
Triospect significantly outperforms existing detectors, achieving up to 22.3% better accuracy against 17 different adversarial attacks.
Existing AI-generated text detectors are vulnerable to attacks that manipulate textual characteristics. In this study, we propose a novel Triospect Detection Framework by using additional perspectives of content (core ideas) and expression (stylistic elements) within a given text. Experiments on two benchmarks involving 17 attacks, 12 domains, and 17 source models demonstrate that Triospect is robust against these attacks. It improves the strong baseline by a significant margin of 22.3% (AUROC) and 13% (TPR01) on the Humanize-16K after-attack subset, and by 9.1% (AUROC) and 22% (TPR01) on the adversarial RAID. This framework marks a pioneering effort in statistical methods to enhance detection reliability against attacks. We release our data and code at https://github.com/baoguangsheng/triospect.
