Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This research develops a culturally-sensitive AI framework to detect health misinformation in low-resource languages, specifically focusing on Bangla. By integrating Small Language Models (SLMs) with a Responsible NLP approach, the study addresses the challenges posed by limited training data and the nuances of language in CALD communities. The findings reveal that the Phi-4 model outperforms others in balancing precision and recall for claim extraction, highlighting the potential for effective misinformation detection in underrepresented contexts.
Phi-4 emerges as a game-changer in health misinformation detection, balancing precision and recall in low-resource languages like Bangla.
Artificial Intelligence (AI) technologies, while serving as a foundational enabler for modern social media and digital health services, exert a bivalent effect by simultaneously acting as a combatant against and a spread vector for misinformation. A prevalent challenge in mitigating this issue arises in non-English contexts and low socioeconomic classes, where limited data hinders the training of AI models for effective detection. Consequently, culturally and linguistically diverse (CALD) communities struggle to access trustworthy health information through AI-driven tools. Current AI tools underperform due to a lack of training data and are largely unable to consider language nuances and traditions in non-English contexts. This research addresses these gaps by proposing a CALD-friendly AI-based health misinformation detector and providing a dashboard for medical professionals to analyse this misinformation, a critical step toward mitigating a growing concern among CALD populations. To this end, we conduct a series of experiments using a Bangla-translated health misinformation dataset to evaluate the performance of various Small Language Models (SLMs). SLMs are particularly relevant in this context given the frequent underperformance of Large Language Models (LLMs), which often stems from insufficient domain-specific knowledge and the prohibitive costs of resource-intensive fine-tuning. The results demonstrate that Phi-4 is the superior model, achieving an ideal balance between precision and recall in claim extraction. Then, to mitigate the limitations of SLMs, we design and test a novel health misinformation detection framework grounded in Responsible Natural Language Processing (NLP), which incorporates cultural sensitivity, potential for harm, and communication quality, thereby providing a holistic lens for evaluating misinformation in low-resource languages.