Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a novel LLM-based detection system for online firestorms, addressing the limitations of traditional detection methods that rely on volume signals and sentiment scores. By employing two modes—retrospective classification of complete Reddit threads and sequential monitoring for early warnings—the system effectively captures contextual shifts in user-generated content. The findings reveal that the early warning mode can detect escalating threads with high recall after minimal input, showcasing the potential of LLMs for dynamic, context-aware analysis of social media discourse.
LLMs can detect online firestorms early, issuing warnings after just a few comments, transforming how we monitor social media dynamics.
Online firestorms are rapid collective escalations of highly negative user-generated content and may cause substantial reputational and economic damage. Existing detectors usually work with volume signals, sentiment scores, or predefined linguistic features. Such signals are useful, but they capture contextual meaning shifts in evolving discussion threads only indirectly. This paper proposes an LLM-based detection system with two operating modes. The first mode classifies complete Reddit threads retrospectively by combining local chunk-level assessments into a thread-level judgment. The second mode processes threads sequentially and issues early warnings when a sliding window exceeds calibrated thresholds. In this mode, the language model estimates three firestorm indicators: negativity share, escalation level, and contributor count. On a balanced Reddit dataset, the global mode achieves strong classification performance, while the early warning mode reaches high recall and detects escalating threads after only a small number of comments and distinct contributors. The results indicate that LLMs can be used not only for static judgment tasks, but also as repeated estimators in context-aware monitoring of social media discourse.