Search papers, labs, and topics across Lattice.
This paper benchmarks GPT-4o against traditional computer vision models (FaceNet512, RetinaFace, Google Cloud Vision) for analyzing visual political communication on Instagram during the 2021 German federal election. The task involved identifying front-runner politicians and counting individuals in images extracted from Instagram stories and posts. GPT-4o significantly outperformed the other models, achieving a macro F1-score of 0.89 for face recognition and 0.86 for person counting, suggesting its superior capability in scaling and refining visual content analysis.
GPT-4o crushes traditional computer vision models at identifying politicians and counting people in Instagram images, signaling a new era for scalable visual political communication analysis.
This paper presents a computational case study that evaluates the capabilities of specialized machine learning models and emerging multimodal large language models for Visual Political Communication (VPC) analysis. Focusing on concentrated visibility in Instagram stories and posts during the 2021 German federal election campaign, we compare the performance of traditional computer vision models (FaceNet512, RetinaFace, Google Cloud Vision) with a multimodal large language model (GPT-4o) in identifying front-runner politicians and counting individuals in images. GPT-4o outperformed the other models, achieving a macro F1-score of 0.89 for face recognition and 0.86 for person counting in stories. These findings demonstrate the potential of advanced AI systems to scale and refine visual content analysis in political communication while highlighting methodological considerations for future research.