Search papers, labs, and topics across Lattice.
This paper introduces a multimodal pipeline combining automatic transcription, aspect-based sentiment analysis (ABSA), and semantic scene classification to analyze YouTube Shorts coverage of the Israel-Hamas war by state-funded outlets. Applying this pipeline to over 2,300 Shorts and 94,000 visual frames, the study reveals variations in sentiment across outlets and consistent visual cues reflecting real-world events. Surprisingly, smaller domain-adapted models outperformed large transformers and LLMs for sentiment analysis, highlighting the efficiency of resource-conscious approaches.
Forget LLMs: surprisingly, smaller, domain-adapted models beat them at sentiment analysis of state-funded news coverage on YouTube Shorts.
YouTube Shorts have become central to news consumption on the platform, yet research on how geopolitical events are represented in this format remains limited. To address this gap, we present a multimodal pipeline that combines automatic transcription, aspect-based sentiment analysis (ABSA), and semantic scene classification. The pipeline is first assessed for feasibility and then applied to analyze short-form coverage of the Israel-Hamas war by state-funded outlets. Using over 2,300 conflict-related Shorts and more than 94,000 visual frames, we systematically examine war reporting across major international broadcasters. Our findings reveal that the sentiment expressed in transcripts regarding specific aspects differs across outlets and over time, whereas scene-type classifications reflect visual cues consistent with real-world events. Notably, smaller domain-adapted models outperform large transformers and even LLMs for sentiment analysis, underscoring the value of resource-efficient approaches for humanities research. The pipeline serves as a template for other short-form platforms, such as TikTok and Instagram, and demonstrates how multimodal methods, combined with qualitative interpretation, can characterize sentiment patterns and visual cues in algorithmically driven video environments.