Search papers, labs, and topics across Lattice.
ArabDiscrim is a new corpus of 293K Arabic Facebook posts from 2014-2024 focused on racism and discrimination, linked to 200 curated terms and 20 discrimination axes. Unlike existing datasets, it incorporates platform-native engagement signals like reactions and shares, allowing for analysis of audience response. The resource enables weak supervision and axis-aware sampling for fairness-oriented Arabic NLP.
Finally, a large-scale, ecologically valid Arabic dataset lets researchers study the interplay of discriminatory language and audience response on Facebook.
We present ArabDiscrim, a decade-long lexical resource and corpus of 293K public Arabic Facebook posts (2014--2024) discussing racism and discrimination. Unlike existing Twitter-centric datasets, ArabDiscrim integrates platform-native engagement signals, including reactions, shares, comments, and page metadata, enabling joint analysis of language and audience response. The resource includes 200 curated terms (100 racism-related and 100 discrimination-related) with morphological regex families (13+ inflections per lemma), and 20 discrimination axes capturing identity-based grounds for unequal treatment. It also provides explicit attribution patterns. Released under a restricted research-use license for ethical compliance with platform terms, ArabDiscrim supports weak supervision, axis-aware sampling, and platform ecology research. By bridging lexical depth and ecological validity, it establishes a foundation for fairness-oriented, platform-aware Arabic NLP.
CMU ML