Search papers, labs, and topics across Lattice.
This paper addresses the challenge of multi-label cyberbullying detection in Bangla by proposing a hybrid architecture that fuses BanglaBERT-Large with a two-layer stacked LSTM to capture both contextual understanding and sequential dependencies. The authors fine-tuned their model on a publicly available Bangla cyberbullying dataset, incorporating sampling strategies to mitigate class imbalance. Experimental results using 5-fold cross-validation demonstrate the effectiveness of the proposed fusion model across multiple evaluation metrics, including accuracy, F1-score, and AUC-ROC.
Fusing BanglaBERT with stacked LSTMs achieves state-of-the-art multi-label cyberbullying detection in Bangla, outperforming unimodal approaches by effectively capturing both contextual nuances and sequential dependencies in text.
Cyberbullying has become a serious and growing concern in todays virtual world. When left unnoticed, it can have adverse consequences for social and mental health. Researchers have explored various types of cyberbullying, but most approaches use single-label classification, assuming that each comment contains only one type of abuse. In reality, a single comment may include overlapping forms such as threats, hate speech, and harassment. Therefore, multilabel detection is both realistic and essential. However, multilabel cyberbullying detection has received limited attention, especially in low-resource languages like Bangla, where robust pre-trained models are scarce. Developing a generalized model with moderate accuracy remains challenging. Transformers offer strong contextual understanding but may miss sequential dependencies, while LSTM models capture temporal flow but lack semantic depth. To address these limitations, we propose a fusion architecture that combines BanglaBERT-Large with a two-layer stacked LSTM. We analyze their behavior to jointly model context and sequence. The model is fine-tuned and evaluated on a publicly available multilabel Bangla cyberbullying dataset covering cyberbully, sexual harassment, threat, and spam. We apply different sampling strategies to address class imbalance. Evaluation uses multiple metrics, including accuracy, precision, recall, F1-score, Hamming loss, Cohens kappa, and AUC-ROC. We employ 5-fold cross-validation to assess the generalization of the architecture.
