Search papers, labs, and topics across Lattice.
This study conducts a forensic analysis of the AI-driven influence campaign known as Storm-1516/CopyCop, utilizing the newly introduced PROPAGIA corpus of 2,646 propagandist articles. By employing topic modeling and sentiment analysis, the authors reveal that PROPAGIA exhibits significantly higher levels of vagueness, subjectivity, and negativity compared to a human-written corpus, SIPA, while also uncovering prompt instruction leaks across multiple websites. The findings not only support attribution to Llama 3 models but also indicate potential involvement of Mistral-family models, highlighting the sophisticated nature of AI-generated propaganda.
PROPAGIA reveals that AI-generated propaganda is not only more vague and subjective but also intricately linked to specific model families, raising alarms about the sophistication of influence campaigns.
We present a forensic analysis of the generation pipeline behind a recent AI-driven influence campaign. We introduce PROPAGIA, a corpus of 2,646 propagandist French articles from the Storm-1516/CopyCop campaign disclosed by VIGINUM and INSIKT GROUP in 2025. For comparison, we rely on SIPA, a corpus of human-written French mainstream press from the same period. Using topic modeling, vagueness and sentiment analysis, we first isolate persuasion techniques characteristic of propaganda, with PROPAGIA far exceeding SIPA in vagueness, subjectivity and negativity, and citing fewer sources. We then find prompt instruction leaks on 50 of the 84 PROPAGIA websites, including a verbatim ten-point editorial specification accounting for several of these differences, together with high cross-article redundancy. Finally, we show that rewriting-based detection supports INSIKT GROUP's attribution to the Llama 3 family, but also suggests the involvement of Mistral-family models.