Search papers, labs, and topics across Lattice.
This paper reframes abusive language detection as a sequence labeling task (Abusive Language Identification - ALI) to jointly extract abusive spans and target mentions, addressing limitations of sentence-level classification in industrial content moderation. By comparing ALI with traditional Abusive Language Classification (ALC) on a production corpus, the study finds ALI competitive while offering localized outputs, though exact span recovery remains challenging. The research highlights ALI's potential for improved moderation by providing finer-grained information, particularly for implicit abuse, while acknowledging areas for future development in target-span linking.
Abusive language detection can be reframed as sequence labeling to pinpoint abusive spans and targets, offering localized moderation insights beyond simple sentence classification.
Industrial content moderation must process massive message streams under tight latency constraints, yet most abusive language (AL) detection systems rely on sentence-level classification (ALC), which neither localizes abusive spans nor identifies who is targeted. We define Abusive Language Identification (ALI) as a sequence-labeling task that jointly extracts AL spans and target mentions, and assess whether this approach can be used for text moderation. On a pilot corpus drawn from a production moderation pipeline, we compare ALI with ALC on cross-domain generalization and implicit abuse, and we also evaluate AL and target span detection. ALI remains competitive with ALC while providing localized outputs for moderators, with a modest and configuration-sensitive advantage on implicit abuse. Exact AL boundaries and target spans remain difficult to recover. We complement this comparison with a qualitative analysis and discuss perspectives on complete target--span linking and on structured benchmarks for ALI.