Search papers, labs, and topics across Lattice.
The authors introduce PerSoMed, a new balanced dataset of 36,000 Persian social media posts across nine categories, addressing the scarcity of resources for Persian text classification. They employed a hybrid annotation approach, combining ChatGPT-based few-shot prompting with human verification, and mitigated class imbalance through undersampling and data augmentation. Benchmarking experiments demonstrate that transformer-based models, particularly TookaBERT-Large, achieve state-of-the-art performance on the dataset, establishing a strong baseline for future Persian NLP research.
A new, balanced, and large-scale dataset for Persian social media text classification promises to unlock advances in trend analysis, social behavior modeling, and user classification for this under-resourced language.
This research introduces the first large-scale, well-balanced Persian social media text classification dataset, specifically designed to address the lack of comprehensive resources in this domain. The dataset comprises 36,000 posts across nine categories (Economic, Artistic, Sports, Political, Social, Health, Psychological, Historical, and Science & Technology), each containing 4,000 samples to ensure balanced class distribution. Data collection involved 60,000 raw posts from various Persian social media platforms, followed by rigorous preprocessing and hybrid annotation combining ChatGPT-based few-shot prompting with human verification. To mitigate class imbalance, we employed undersampling with semantic redundancy removal and advanced data augmentation strategies integrating lexical replacement and generative prompting. We benchmarked several models, including BiLSTM, XLM-RoBERTa (with LoRA and AdaLoRA adaptations), FaBERT, SBERT-based architectures, and the Persian-specific TookaBERT (Base and Large). Experimental results show that transformer-based models consistently outperform traditional neural networks, with TookaBERT-Large achieving the best performance (Precision: 0.9622, Recall: 0.9621, F1- score: 0.9621). Class-wise evaluation further confirms robust performance across all categories, though social and political texts exhibited slightly lower scores due to inherent ambiguity. This research presents a new high-quality dataset and provides comprehensive evaluations of cutting-edge models, establishing a solid foundation for further developments in Persian NLP, including trend analysis, social behavior modeling, and user classification. The dataset is publicly available to support future research endeavors.
