Search papers, labs, and topics across Lattice.
This study employs embedding-based dynamic topic modeling to analyze 12.7 billion Reddit comments from 2006 to 2022, revealing how topics evolve at the comment level. By leveraging pretrained language models for contextualized semantic embeddings, the authors identify significant directional drift in politically and socially contentious topics, contrasting with the stability observed in domains like music and sports. The introduction of a null model comparison test enhances the robustness of their findings, demonstrating that topic dynamics are not merely spurious but reflect genuine shifts in discourse.
Politically charged topics on Reddit exhibit significant directional drift over time, while music and sports discussions remain surprisingly stable.
We present a novel application of embedding-based dynamic topic modeling techniques to detect and quantify topic drift at the comment level in a massive corpus. By leveraging pretrained language models to generate contextualized semantic embeddings for short text, we analyzed 12.7 billion Reddit comments spanning 2006 to 2022. Using unsupervised methods on these embeddings, we identify dynamically evolving topic clusters over time. Our primary contribution is a methodology for analysis of semantic drift and discourse evolution in the embedding space itself. We also demonstrate modifications to existing methods that enable this analysis at scale, and we propose and demonstrate a null model comparison test to filter spurious dynamics. Key findings suggest that politically and socially contentious topics exhibit significant directional drift in embedding space, with inter-topic distances changing systematically over time beyond what the null model can explain, whereas domains such as music and sports remain comparatively stable.
