Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study leverages multimodal large language models (LLMs) to automate the annotation of 77 theory-driven structural variables in TikTok videos, addressing the challenges of manual annotation in audiovisual content analysis. By analyzing a dataset of approximately 10,000 TikTok videos from brand and organizational accounts in Estonia, the authors achieve modest but consistent improvements in engagement estimation compared to traditional baselines. The findings reveal a reliability gradient in human validation, indicating that while perceptual variables can be reliably coded, deeper semiotic constructs remain challenging for both humans and machines, highlighting the nuanced capabilities of LLMs in cultural analytics.
Automating the annotation of TikTok videos with LLMs reveals that deeper semiotic insights remain elusive, even as engagement metrics improve.
Short-form video is difficult to study at scale because meaning emerges through audiovisual elements, language, and participatory, algorithmic and trend-based platform dynamics. Manual annotation of these layers is laborious at scale and difficult to standardize. We demonstrate how multimodal large language models (LLMs) can help address this bottleneck by annotating a set of 77 theory-driven structural variables derived from narratology, rhetoric, communication, and semiotics. We use this to explore content and estimate engagement with modest but consistent gains over account-size and video-age baselines in a corpus of about 10,000 TikTok videos of brand and organizational accounts from Estonia (covering a substantial share of the small country ecosystem). Human validation shows a reliability gradient: perceptual and communicative variables can be coded fairly reliably, while deeper semiotic and archetypal constructs are more difficult for both humans and machines. This approach of computational operationalization of long-standing interpretive theories can support several aims: exploratory cultural analytics of variation in short-form video culture, predictive modeling of platform dynamics, engagement, and audience feedback; and diagnostics for content creators to support choosing between structural and narrative strategies. Most annotated variables were not associated with platform success, as expected; the value of LLMs in this setting lies in making it feasible to assess large batteries of theoretically motivated variables, so that the subset carrying signal can be identified and translated into creator-facing guidance for a given niche.