Search papers, labs, and topics across Lattice.
This study addresses the issue of overconfidence in multimodal large language models (MLLMs) used for Medical Visual Question Answering (VQA) by introducing a novel training framework that enhances uncertainty calibration. The proposed method employs a composite loss function that integrates multiple components, including a Brier style calibration term and a contrastive image-text alignment term, to fine-tune MLLMs effectively. Results show that the approach reduces calibration error by over 60% and improves discrimination by more than 26% across various benchmarks, while maintaining predictive accuracy, outperforming existing calibration techniques.
MLLMs in Medical VQA can be fine-tuned to reduce overconfidence by over 60%, fundamentally changing how we assess model reliability in clinical settings.
Multimodal large language models (MLLMs) applied to Medical Visual Question Answering (VQA) tend to produce overconfident outputs regardless of actual correctness, and existing verbalized confidence calibration methods, developed primarily for text only LLMs, do not account for the multimodal nature of medical image understanding. This work proposes a training based framework that finetunes MLLMs to improve their calibration using a composite loss function combining a Brier style calibration term, an anchor regularizer that prevents confidence collapse toward extreme values, a contrastive image text alignment term, and a KL based model stabilization term. The alignment signal is derived from a $2 \times 2$ factorial perturbation design that crosses image presence with text integrity, probing the reliance of the model on visual modality input versus language priors. Finally, a top K KL divergence regularizer is used to protect the answering ability of the model during finetuning. Across three Medical VQA benchmarks and two architectures (MedGemma 4B IT and Qwen2 VL 7B Instruct), our method reduces calibration error by 60% or more, and improves discrimination by 26% or more, while preserving predictive accuracy. On average across benchmarks, the technique outperforms prompting based, sampling based, and training based approaches, and ablation experiments confirm that each component of the loss function is indeed necessary for improving the calibration. All code for the experiments is publicly available.
