Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces SentiBanglaBERT, a two-stage framework for Bengali sentiment classification that leverages domain-adaptive continual pretraining and parameter-efficient fine-tuning via Low-Rank Adaptation (LoRA). The approach addresses the challenge of sentiment analysis in low-resource languages by enabling effective adaptation to news-style data while maintaining computational efficiency. Experimental results show that SentiBanglaBERT achieves stable performance on par with strong baselines, while also providing interpretability through SHAP, revealing the impact of Bengali morphological features on sentiment predictions.
SentiBanglaBERT not only matches state-of-the-art performance but also uncovers how Bengali linguistic nuances shape sentiment analysis.
Understanding sentiment in low-resource languages remains a key challenge for Natural Language Processing (NLP), particularly when domain-specific data is scarce. In this work, we present SentiBanglaBERT, a two-stage Bengali sentiment classification framework combining domain-adaptive continual pretraining and parameter-efficient fine-tuning. The approach enables contextual adaptation to news-style data while remaining computationally efficient through Low-Rank Adaptation (LoRA). Beyond performance, SentiBanglaBERT integrates SHAP-based interpretability, offering linguistic insights into how Bengali morphological cues, such as negation suffixes and aspectual markers, influence sentiment predictions. Experiments demonstrate stable performance comparable to strong baselines while providing greater transparency and interpretive depth. This framework highlights the potential of domain-adaptive continual learning as a foundation for interpretable, resource-efficient NLP in morphologically rich, underrepresented languages.