Search papers, labs, and topics across Lattice.
This paper introduces FigSIM, the first annotated dataset specifically designed for the fine-grained analysis of suicide memes, comprising 1,049 memes annotated for suicide severity, figurative language, and suicide-related content. The study benchmarks 16 unimodal and multimodal models on tasks related to figurative language and suicide severity detection, revealing significant challenges in accurately modeling these memes, particularly an underprediction of higher severity levels in figurative cases. The findings underscore the urgent need for effective content moderation strategies to mitigate the potential harm of these memes on social media platforms.
Suicide memes reveal unique modeling challenges, with higher severity levels often underpredicted, highlighting critical gaps in content moderation strategies.
Suicide memes are memes used to express suicide-related thoughts or comment on suicide-related issues. Suicide memes are increasingly common on social media, yet remain poorly understood and potentially harmful. There is an urgent need to better understand their characteristics and to develop appropriate content moderation strategies that limits users' exposure to potentially harmful content. Currently, the absence of annotated datasets of suicide memes remains a key barrier to developing and evaluating automated moderation approaches. In this paper, we introduce FigSIM, the first dataset designed for fine-grained analysis of suicide memes. The dataset consists of 1049 memes, each annotated for (1) fine-grained suicide severity levels, (2) figurative phenomena (e.g., metaphors), and (3) suicide-related content (e.g., suicide method depiction). We benchmark 16 unimodal and multimodal models across three tasks: figurative language, suicide severity, and suicide-related content detection. Overall, FigSIM demonstrates that suicide memes pose unique challenges for both modeling and content moderation. Analysis revealed biases, such as underprediction of higher suicide severity levels, especially for figurative memes. The dataset (including splits used for analyses) is publicly available. Content Warning: This paper contains suicide-related content that may be triggering.
