Search papers, labs, and topics across Lattice.
This study evaluates the reliance of vision-language models on chest radiographs by implementing a causal audit that occludes and swaps images to assess whether the models' accuracy is dependent on visual input. The findings reveal that a text-only model can achieve accuracy within 5.7 points of the best multimodal model, challenging the assumption that image access is crucial for performance. Notably, the research categorizes models based on their use of images, highlighting that some models may exploit prior knowledge rather than genuinely interpreting the scans, which raises important implications for clinical deployment standards.
Text-only models can rival multimodal counterparts in chest radiography accuracy, questioning the necessity of image input for clinical AI applications.
Medical vision-language models report strong chest radiograph accuracy, and this is increasingly read as evidence that they use the image. That inference is unsafe: a model exploiting finding-name priors scores like one that reads the scan, and no standard benchmark separates them. We introduce a causal audit that intervenes on the image, occluding the relevant region, occluding an irrelevant one, and swapping in another patient's same-label scan, and combines three behavioral metrics to test whether a correct answer depends on the image. Across nine systems, a text-only model with no image access reaches within 5.7 accuracy points of the best multimodal one, and a 119-billion-parameter multimodal model is statistically indistinguishable from a 7-billion text-only baseline. The audit splits the cohort into three models that ignore the image, one that is unstable, and five that use it selectively, for a subset of findings; the categories hold across a second dataset, resolution, and prompt phrasing. Against board-certified radiologists, a text-only model is statistically indistinguishable from a radiologist's accuracy while grounding at zero, whereas the image-using models ground at radiologist-comparable rates. Reported confidence flags ungrounded answers only when a model uses the image. Grounding audits, not accuracy, should gate clinical deployment.
