Search papers, labs, and topics across Lattice.
This paper develops and compares four neural architectures (MLP, 1D-CNN, MobileNet-based CNN, Transformer) for detecting AI-generated text. They benchmark these models against eight widely used online AI text detectors using the COLING Multilingual Dataset (English and Italian) and a new dataset focused on Art and Mental Health. Results indicate that supervised detectors outperform commercial tools in terms of stability and robustness across languages and domains.
Supervised learning models can reliably outperform widely-used commercial AI text detectors, even across different languages and specialized domains like mental health.
The rapid proliferation of Large Language Models has significantly increased the difficulty of distinguishing between human-written and AI generated texts, raising critical issues across academic, editorial, and social domains. This paper investigates the problem of AI generated text detection through the design, implementation, and comparative evaluation of multiple machine learning based detectors. Four neural architectures are developed and analyzed: a Multilayer Perceptron, a one-dimensional Convolutional Neural Network, a MobileNet-based CNN, and a Transformer model. The proposed models are benchmarked against widely used online detectors, including ZeroGPT, GPTZero, QuillBot, Originality.AI, Sapling, IsGen, Rephrase, and Writer. Experiments are conducted on the COLING Multilingual Dataset, considering both English and Italian configurations, as well as on an original thematic dataset focused on Art and Mental Health. Results show that supervised detectors achieve more stable and robust performance than commercial tools across different languages and domains, highlighting key strengths and limitations of current detection strategies.
