Search papers, labs, and topics across Lattice.
This paper introduces AVShift, a comprehensive benchmark for authorship verification (AV) that evaluates model robustness against distribution shifts in genre, time, and AI-assisted writing, specifically for the German language. By analyzing over 150,000 text pairs across three genres and 21 years, the authors reveal that fine-tuned LLMs outperform other methods when trained on stylistically diverse data, while temporal drift significantly hampers AV performance. Notably, the study finds no substantial evidence of AI-era distribution shifts affecting authorship verification, highlighting the nuanced impact of genre and time on stylistic features.
Temporal drift is a major adversary in authorship verification, causing significant performance degradation as the time gap between documents widens.
Authorship verification (AV) assumes that an author's writing style remains sufficiently stable to distinguish it from that of other writers. In practice, however, this assumption is challenged by distribution shifts caused by changes in genre, time, and AI-assisted writing. Existing AV benchmarks typically study these factors in isolation and focus predominantly on English, limiting our understanding of model robustness under realistic conditions. We introduce AVShift, the first German benchmark for systematically evaluating AV under multiple distribution shifts. AVShift comprises over 150,000 text pairs spanning three genres and 21 years, enabling controlled evaluation of cross-genre, temporal, and AI-era shifts within a unified framework. We benchmark representative feature-based, embedding-based, and LLM-based approaches. Our experiments show that fine-tuned LLMs generalize best across genres and benefit substantially from stylistically diverse training data. We further demonstrate that temporal drift is one of the strongest factors affecting AV, with performance degrading significantly as the time gap between documents increases. In contrast, we find no evidence of a measurable AI-era distribution shift within AVShift. Finally, our feature analysis reveals stylistic features that remain stable across genres, while their relative importance varies depending on the specific genre transition. We release AVShift and our code for future research.
