Search papers, labs, and topics across Lattice.
This study introduces BrReMark, a framework for enhancing brain MRI anomaly detection by incorporating explicit region marking to ground diagnoses in spatial evidence. By generating hypotheses about potential abnormalities and verifying them through marked evidence, the model significantly improves diagnostic accuracy and reduces hallucinations in outputs. The results show a remarkable increase in mean Average Precision (mAP50) from 0.74% to 37.54%, alongside improved Clinical F1 and diagnostic accuracy metrics, demonstrating the effectiveness of the approach in both in-distribution and out-of-distribution scenarios.
Explicitly marking regions of interest in brain MRIs leads to a staggering 37.54% improvement in anomaly detection accuracy, transforming how diagnoses are made.
Medical vision-language models typically generate diagnoses through single-pass inference without indicating which image regions support their conclusions. This lack of spatial grounding limits clinical utility: outputs cannot be audited, and models may hallucinate findings on normal scans. We present BrReMark (Brain Rethink via ROI Marking), a framework that introduces explicit region marking into brain MRI diagnosis. The model first generates hypotheses about potential abnormalities and grounds them through explicit bounding box marking, then verifies conclusions by re-examining the marked evidence. Training combines supervised fine-tuning on structured reasoning trajectories with reinforcement learning using a composite reward over localization accuracy and diagnostic reasoning. Furthermore, we integrate a domain randomization-based pathology synthesis augmentation strategy to improve the model's generalizability to out-of-distribution (OOD) data. On internal benchmark, BrReMark improves mAP50 from 0.74% to 37.54% compared to the base model, while achieving 21.57% Clinical F1 and 45.26% diagnostic accuracy. On NOVA OOD benchmark, it also achieves competitive overall performance with a 45.7% reduction in false positives compared to the state-of-the-art, indicating reduced hallucination on rare pathologies. These findings suggest that explicit hypothesis-verification grounding is a practical path toward trustworthy open-ended brain MRI diagnosis across both in-distribution and OOD settings.
