Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper benchmarks several classical and transformer-based models for sentiment classification on the IMDb dataset. It compares Naive Bayes, Logistic Regression, SVM, LightGBM, LSTM, RoBERTa, and DistilBERT, finding that RoBERTa achieves the highest accuracy at 93.02%. Furthermore, the authors demonstrate that a soft voting ensemble of all models further improves performance, highlighting the effectiveness of ensembling for sentiment analysis tasks.
A simple ensemble of classic ML models and transformers beats individual models at sentiment classification, suggesting that diversity still matters in the age of LLMs.
Sentiment analysis, also referred to as opinion mining, primarily tries to extract opinion from any text-based data. In the context of movie reviews and critics, sentimental analysis can be a helpful tool to predict whether a movie review is generally positive or negative. It can be difficult for the ML models to understand the context or metaphysical sentiment accurately, as ML models rely largely on statistical word representations. The objective of this paper is to examine and categorise movie reviews into positive and negative sentiments. Diverse machine learning models are considered in doing so, and Natural Language Processing (NLP) methodologies are employed for data preprocessing and model assessment. The IMDb dataset is used. Specifically, Naive Bayes, Logistic Regression, Support Vector Machines (SVM), LightGBM, LSTM, and transformer-based models such as RoBERTa and DistilBERT were evaluated. After a lot of testing with accuracy, precision, recall, F1-score, and ROC-AUC, RoBERTa performed better than all the other models, with an accuracy of 93.02%. A soft voting ensemble that combined all the models also improved classification performance, showing that model ensembling works well for sentiment analysis.