Search papers, labs, and topics across Lattice.
This paper explores the transition of medical agents from task-specific tools to autonomous systems capable of perceiving, reasoning, and acting within clinical environments. It emphasizes the importance of clinical deployment over mere capability enhancement, proposing a three-level autonomy taxonomy and a unified scaling framework that includes framework, capability, and environment scaling. The authors highlight clinical environment scaling as a critical yet underexplored area, advocating for the development of self-evolving agents that improve through interaction rather than just parameter scaling, ultimately aiming to enhance trustworthiness in medical imaging applications.
Trustworthy medical agents could evolve autonomously through interactive learning, rather than relying solely on parameter scaling.
The growing ability of large language models and vision language models to jointly interpret and reason over images and text is reshaping medical agents, moving them from task specific predictors toward autonomous systems that perceive, reason, plan, remember, and act in clinical environments. This work departs from the capability first perspective of existing literature and instead begins from clinical deployment, asking what tasks, contamination resistant benchmarks, and interactive training environments are required before medical agents can be trusted in practice. Medical agents are formalized as sequential decision making systems under partial observability, together with a three level autonomy taxonomy spanning assisted, cooperative, and fully autonomous operation. The field is organized along a unified scaling spine consisting of framework scaling, capability scaling, and environment scaling. Within this framework, clinical environment scaling, the integration of tools, data, and clinical gyms, is identified as the most actionable yet underexplored direction for agents operating in PACS, EHR, and FHIR ecosystems. Clinical self evolution, where agents improve through interaction with their environments rather than parameter scaling alone, is further positioned as a key research frontier, drawing insights from self improving agents, agent gyms, and test time compute scaling. Applications across radiology, pathology, ophthalmology, and hospital workflows are examined together with deployment challenges including hallucination, cascading failures, and fairness. By consolidating more than 300 references, with particular emphasis on advances from 2025 to 2026, this work provides a roadmap toward trustworthy, self improving medical imaging systems for real clinical practice.
