Search papers, labs, and topics across Lattice.
This study evaluates the diagnostic robustness of four vision-language models (VLMs) using a histopathology-validated brain MRI dataset, focusing on their performance under controlled visual and textual perturbations. The authors found that models exhibited significant vulnerabilities, with prediction inconsistencies occurring in up to 48.9% of cases due to simple reordering of anatomical slices and up to 67.8% when labels were swapped, despite unchanged visual evidence. These findings underscore the inadequacy of standard accuracy metrics, revealing that high accuracy can obscure critical reliability issues in clinical settings, necessitating the development of stability-based evaluation metrics for VLMs.
VLMs can flip predictions in nearly half of cases due to simple changes in presentation order, revealing hidden vulnerabilities in clinical reliability.
Standard accuracy metrics for VLMs often mask significant reliability failures in sensitive domains. In this work, we utilize a histopathology-validated brain MRI dataset to systematically assess the diagnostic robustness of four VLM families under evidence-preserving perturbations. By reordering anatomical slices and swapping target label positions, we evaluate whether models maintain consistent predictions when clinical evidence remains invariant. Our results reveal significant vulnerabilities in presentation-order stability, with models exhibiting prediction flips in up to 48.9% of cases under simple sequence reversals. We further identify a textual selection bias, where label reordering triggers inconsistent diagnoses in up to 67.8% of cases despite identical visual inputs. Negative-control tests further reveal diagnostic overcommitment: models generate categorical diagnoses in up to 76.1% of cases after expert-annotated lesion slices are removed. These results demonstrate that high accuracy can overestimate clinical reliability, masking sensitivity to sequential presentation and textual framing that is not captured by aggregate accuracy. Our findings highlight the necessity of stability-based metrics for the deployment of VLMs in safety-critical clinical applications. Our evaluation data and code will be made public upon acceptance.
