Search papers, labs, and topics across Lattice.
This study introduces Rule-Aware FinBERT (RA-FinBERT), a novel framework that enhances financial sentiment classification by integrating low-rank adaptation (LoRA) with rule-derived sentiment features and metadata. By concatenating a four-dimensional feature vector with the FinBERT [CLS] representation, RA-FinBERT achieves a significant performance boost, reaching 69.89% accuracy and a macro F1 score of 0.634, compared to 63.44% accuracy and 0.526 F1 for the standard text-only FinBERT. Notably, the model also improves neutral-class recall from 18.18% to 45.45%, demonstrating the efficacy of combining contextual and rule-based features in a resource-efficient manner.
Rule-Aware FinBERT boosts financial sentiment classification accuracy by over 6% while adding only 1,024 trainable weights, showcasing the power of integrating rule-derived features with contextual embeddings.
Financial sentiment analysis converts unstructured financial news into quantitative signals that can support market analysis and decision-making. Existing work on resource-efficient financial NLP has largely focused on compressing or adapting pretrained language models, with less attention to combining contextual representations with lightweight rule-derived features. This study develops Rule-Aware FinBERT (RA-FinBERT), a parameter-efficient framework that integrates low-rank adaptation (LoRA) with three continuous VADER-derived sentiment proportions (positive, negative, and neutral) and a source-level metadata feature. The standardized four-dimensional feature vector is directly concatenated with the 768-dimensional final-layer FinBERT [CLS] representation and passed through a lightweight classification head. This design introduces only 1,024 additional trainable weights relative to a structurally matched text-only FinBERT model. RA-FinBERT was evaluated against text-only FinBERT and a lightweight DistilBERT baseline for three-class sentiment classification of financial-news titles and descriptions. On the held-out test set, RA-FinBERT achieved 69.89% accuracy and a macro F1 score of 0.634, compared with 63.44% and 0.526 for text-only FinBERT. Neutral-class recall increased from 18.18% to 45.45%. The framework supports both CPU and GPU execution, offering a lightweight and practical approach to financial sentiment classification under constrained computational resources. These findings indicate that rule-derived sentiment information and source metadata can provide complementary signals to contextual FinBERT representations and improve performance with minimal additional model complexity.
