Search papers, labs, and topics across Lattice.
This study investigates the misalignment between confidence and accuracy in Multimodal Large Language Models (MLLMs) within medical tasks, specifically focusing on Medical Visual Question Answering (VQA). By employing a novel method that integrates Multi-Strategy Fusion-Based Interrogation (MS-FBI) with auxiliary expert LLM assessments, the authors achieve a 40% reduction in Expected Calibration Error (ECE) across three datasets. The results underscore the critical need for domain-specific calibration in healthcare applications to enhance the reliability of AI-assisted diagnosis.
MLLMs can mislead medical professionals by misaligning confidence with accuracy, but a new calibration method cuts Expected Calibration Error by 40%.
Multimodal Large Language Models (MLLMs) show great potential in medical tasks, but their elicited confidence often misaligns with actual accuracy, potentially leading to misdiagnosis or overlooking correct advice. This study presents the first comprehensive analysis of the relationship between accuracy and confidence in medical MLLMs. It proposes a novel method that combines Multi-Strategy Fusion-Based Interrogation (MS-FBI) with auxiliary expert LLM assessment, aiming to improve confidence calibration in Medical Visual Question Answering (VQA). Experiments demonstrate that our method reduces the Expected Calibration Error (ECE) by an average of 40\% across three Medical VQA datasets, significantly enhancing MLLMs' reliability. The findings highlight the importance of domain-specific calibration for MLLMs in healthcare, offering a more trustworthy solution for AI-assisted diagnosis.
