Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper addresses the challenge of authorship attribution for LLM-generated texts by moving beyond surface-level linguistic features to analyze reasoning structures using a graph neural network approach. By employing an argument mining pipeline to extract reasoning graphs, the authors demonstrate significant improvements in robustness against obfuscation techniques like paraphrasing and backtranslation. The proposed method outperforms a traditional Longformer baseline by up to 27 percentage points, showcasing its effectiveness in real-world scenarios with evolving LLM versions.
Reasoning graphs can enhance LLM authorship attribution, achieving up to 27% better accuracy against obfuscation tactics than traditional methods.
Given the current trend to employ large language models (LLMs) in almost any imaginable context, LLM-generated text detection and authorship attribution have become a pressing issue. Prior work has primarily focused on surface-level linguistic features, an approach shown to be susceptible to paraphrasing and other obfuscation techniques. In this paper, we go beyond the linguistic surface, extracting and analysing reasoning structures in LLM-generated texts with the goal of capturing more complex signals of LLM authorship. We propose a graph neural network approach that leverages reasoning graphs extracted by an argument mining pipeline, demonstrating improved robustness and generalisation over a traditional Longformer baseline. Our approach outperforms the baseline by up to 27 percentage points under the obfuscation attacks such as paraphrasing and backtranslation, and 19 percentage points when evaluated on the texts generated by the unseen model versions, simulating real-world conditions in which new LLM versions are continuously released.