Search papers, labs, and topics across Lattice.
The paper introduces DependencyAI, a method for detecting AI-generated text that relies solely on the labels of linguistic dependency relations extracted from text. This approach is important because it offers an interpretable and non-neural network alternative to existing detection methods, which are often black boxes. DependencyAI achieves competitive performance in monolingual, multi-generator, and multilingual settings, and feature importance analysis reveals specific syntactic structures that differentiate AI-generated and human-written text.
Surprisingly, linguistic dependency relations alone offer a robust and interpretable signal for detecting AI-generated text, rivaling neural network approaches.
As large language models (LLMs) become increasingly prevalent, reliable methods for detecting AI-generated text are critical for mitigating potential risks. We introduce DependencyAI, a simple and interpretable approach for detecting AI-generated text using only the labels of linguistic dependency relations. Our method achieves competitive performance across monolingual, multi-generator, and multilingual settings. To increase interpretability, we analyze feature importance to reveal syntactic structures that distinguish AI-generated from human-written text. We also observe a systematic overprediction of certain models on unseen domains, suggesting that generator-specific writing styles may affect cross-domain generalization. Overall, our results demonstrate that dependency relations alone provide a robust signal for AI-generated text detection, establishing DependencyAI as a strong linguistically grounded, interpretable, and non-neural network baseline.