Search papers, labs, and topics across Lattice.
This study conducts a longitudinal analysis of AI detection strategies employed by users in two Reddit communities over a span of nearly three years. By examining 13,098 posts and 222,060 comments, the authors identify and categorize 12 distinct strategies that users employ to differentiate between AI-generated and human-generated content, revealing how these strategies evolve in response to advancements in generative AI models and social trends. The findings highlight the dynamic nature of public perception and understanding of AI capabilities, providing a foundation for future research and user guidance on AI detection.
Users adapt their AI detection strategies in real-time, reflecting both the evolution of generative models and shifting social dynamics.
As AI-generated content (e.g., "slop") becomes more prevalent online, people are developing strategies to attempt to identify it (or, conversely, to gain confidence that something is not AI-generated). What strategies are people using, and how are they changing over time as generative AI models themselves change? In this work, we catalog and analyze 2 years and 8 months of the AI detection strategies discussed by users of two popular Reddit communities (r/isthisAI and r/RealOrAI) that use the wisdom of crowds to identify AI-generated media. Through a mixed-method analysis of 13,098 posts and 222,060 comments within these communities, we catalog and analyze the prevalence of 12 AI-detection strategies, including examining fine-grained physical details, recognizing trends in AI-created content, and the assumptions people make about what models are capable of producing. Furthermore, we find that these strategies and mental models shift over time in accordance with changing AI capabilities and in response to online social trends. By systematically cataloging users' AI detection strategies, we lay the groundwork for user-facing guidance and future research.
UW