Search papers, labs, and topics across Lattice.
MIRA (Medical Image Reflection for Agentic Diagnosis) is a novel framework that enhances medical visual agents' diagnostic capabilities by integrating dynamic image-processing operations and web search with a focus on reflective verification of evidence. The framework employs a two-stage training strategy, utilizing a tool-augmented Monte Carlo Tree Search for hypothesis exploration and reinforcement learning to refine decision-making principles based on performance feedback. MIRA demonstrates significant improvements across nine medical visual reasoning benchmarks, achieving an average score of 64.73 and enhancing the accuracy of tool-use judgments while minimizing harmful decisions.
MIRA not only boosts diagnostic accuracy but also transforms how medical visual agents evaluate the necessity and reliability of their tool use, achieving a remarkable reduction in harmful judgments.
Medical visual agents can use tools to inspect images and retrieve external knowledge, but indiscriminate tool use may introduce noisy or misleading evidence. Reliable diagnosis therefore requires not only acquiring additional observations, but also verifying whether tool actions are necessary and whether the resulting evidence supports the current hypothesis. We introduce MIRA (Medical Image Reflection for Agentic Diagnosis), a medical visual diagnostic framework for autonomous evidence search and reflective verification. MIRA dynamically invokes image-processing operations, including zooming, grounding, pointing, rotation, and measurement, as well as web search, while evaluating the relevance and consistency of the acquired evidence. We develop MIRA through a two-stage training strategy. First, a tool-augmented Monte Carlo Tree Search data engine explores diverse diagnostic hypotheses and jointly verifies visual grounding accuracy and semantic consistency to construct supervised fine-tuning trajectories. Second, reinforcement learning further improves decision-making through online reflective principle evolution: failure cases are distilled into candidate principles, and only principles that improve held-out rollout rewards are retained. Across nine medical visual reasoning benchmarks, MIRA achieves an average score of 64.73, improving its Qwen3-VL-8B backbone by 7.44 points. It also increases useful tool-use judgments from 56.2% to 73.8% and reduces harmful judgments from 8.9% to 1.6%. Qualitative analyses show that MIRA can re-examine evidence, correct premature conclusions, and adapt its tool-use strategy. Project page: https://MIRA-VL.github.io/
