Search papers, labs, and topics across Lattice.
This paper introduces CARE, a Confidence-Aware Reasoning framework designed to enhance the reliability of medical visual question answering (VQA) by addressing confidence miscalibration in Multimodal Large Language Models (MLLMs). By employing a dual-stage pipeline that synthesizes structured data for Supervised Fine-Tuning and utilizes Group Relative Policy Optimization with a Confidence-Aware Reward mechanism, CARE optimizes both diagnostic accuracy and calibration. The results demonstrate that CARE achieves the highest diagnostic accuracy with the lowest Expected Calibration Error and Hallucination Rate across three Medical VQA benchmarks, paving the way for more trustworthy clinical decision support systems.
Confidence miscalibration in medical AI can be mitigated, leading to both higher diagnostic accuracy and improved trust in clinical applications.
Reinforcement Fine-Tuning (RFT) has enabled medical Multimodal Large Language Models (MLLMs) to produce Chain-of-Thought (CoT) reasoning for visual question answering, yet these models suffer from $\textit{confidence miscalibration}$---a systematic gap between expressed certainty and actual diagnostic accuracy that undermines clinical trust. We propose $\textbf{CARE}$, a $\textbf{C}$onfidence-$\textbf{A}$ware medical $\textbf{RE}$asoning framework that jointly optimizes accuracy and calibration through a dual-stage pipeline. First, a scalable Medical-CoT synthesis provides structured cold-start data for Supervised Fine-Tuning. Second, Group Relative Policy Optimization (GRPO) with a novel $\textbf{Confidence-Aware Reward (CAR)}$ mechanism ties the model's confidence to diagnostic correctness within the reward signal. Across three Medical VQA benchmarks, $\textbf{CARE}$ achieves the highest diagnostic accuracy while obtaining the lowest Expected Calibration Error and Hallucination Rate, establishing a foundation for trustworthy clinical decision support. Our code is available at https://github.com/anotherbricki/CARE.
