Search papers, labs, and topics across Lattice.
OpenMedQ is a medical vision-language model pretrained on an extensive dataset comprising 14 diverse medical sources, totaling approximately 3.35 million samples. It achieves state-of-the-art performance on the PathVQA benchmark with a BLEU-1 score of 75.9, surpassing even larger models like Med-PaLM M, and matches the best results on VQA-MED. Additionally, its vision encoder demonstrates superior performance on eight unseen medical classification tasks, achieving an average macro-F1 score of 0.757, outperforming several existing models.
OpenMedQ outperforms even the largest models in medical vision-language tasks, achieving state-of-the-art results with a fraction of the parameters.
We present OpenMedQ, a medical vision-language model pretrained on the broadest fully-open medical mix to date: 14 datasets totaling ~3.35M pretraining samples spanning pathology, radiology, microscopy, and text-only clinical QA. OpenMedQ reaches state-of-the-art BLEU-1 on PathVQA (75.9), beating Med-PaLM M variants up to 562B parameters (~80x larger), and matches the best reported VQA-MED BLEU-1 (64.5). Its vision encoder, transferred to 8 unseen medical classification benchmarks under an identical downstream recipe, obtains the highest average macro-F1 (0.757) among BiomedCLIP (0.745), PMC-CLIP (0.745), PubMedCLIP (0.746), and a from-scratch baseline (0.616). We release our code and an interactive demo is publicly available as a reproducible baseline for the community.
Stanford HAI