Search papers, labs, and topics across Lattice.
This paper introduces a framework for leveraging social media data to evaluate the societal impact of consumer AI products, specifically through a longitudinal analysis of the r/ChatGPT subreddit. The study reveals that ChatGPT has transitioned from a novel technology to a normalized consumer product, with notable increases in discussions around its use for mental health support and emotional attachment following the launch of GPT-4o. Utilizing the proposed PuLSE method, the authors demonstrate the capability to detect shifts in public sentiment and engagement months prior to official acknowledgments from OpenAI, highlighting the framework's potential for real-time monitoring of societal trends.
Posts about emotional attachments to ChatGPT surged months before OpenAI acknowledged its societal impact, revealing a hidden narrative in public sentiment.
ChatGPT was launched on November 30, 2022; the r/ChatGPT subreddit was created just one day later. Since then, chatbot-based AI products have gone from niche proofs-of-concept to widely-used household names. However, the ways in which adoption has developed among the public remains poorly understood. In this paper, we develop a framework for using social media as a data source for understanding the societal impact of widely-adopted consumer AI products, and propose PuLSE (Public and Longitudinal Signals for Evaluation), a general approach to monitoring for societally-impactful trends in real time. We apply our framework to conduct what is, to the best of our knowledge, the first longitudinal study of r/ChatGPT. We find that, overall, r/ChatGPT posts over time illustrate the normalization of ChatGPT as an everyday consumer product rather than an exceptional, novel technology. However, our retrospective analysis also finds that posts about using ChatGPT for mental health support, and posts about developing emotional attachments to ChatGPT, both rise steadily in frequency almost immediately after the launch of GPT-4o in May 2024. We show that PuLSE can detect the increase in emotional engagement as early as October 2024 -- months before OpenAI made any (public) acknowledgment of this impact. An interactive site to explore our results and methods, updated daily with live data, is available at rchatgpt-pulse.github.io.
BAIR