Search papers, labs, and topics across Lattice.
This paper introduces MedGuards, a multi-agent framework designed for reliable detection and correction of medical errors in text generated by Large Language Models (LLMs). By employing specialized agents that detect, localize, and correct errors, along with a confidence-guided arbitration mechanism, the system significantly enhances interpretability and robustness without necessitating additional training of the LLMs. Experiments on four multilingual medical datasets reveal that MedGuards outperforms existing methods, highlighting its potential for safer LLM deployment in healthcare settings.
MedGuards achieves significant improvements in medical error detection and correction by leveraging a multi-agent system that enhances interpretability and robustness without retraining LLMs.
As Large Language Models (LLMs) are increasingly deployed in healthcare settings, accurate error detection and correction in generated or existing text becomes critical, as even minor mistakes can pose risks to patient safety. Existing methods for error detection and correction, including automated checks and heuristic-based approaches, do not generalize well across unseen datasets. In this paper, we propose MedGuards as a medical safety guardrail, which is a new framework that treats medical error detection and correction as a multi-agent in-context learning task. Specialized agents separately detect, localize, and correct errors, while a confidence-guided arbitration mechanism resolves disagreements using reasoning traces and confidence scores. This design enhances interpretability, robustness, and adaptability, without requiring additional training of the base LLMs. Additionally, we introduce the Keyword-Prioritized Correction Score (KPCS), a new evaluation metric that considers whether critical keywords within the reference text are generated correctly, providing a more comprehensive assessment than conventional metrics. Experiments across four multilingual medical datasets consisting of clinical notes demonstrate significant improvements by the proposed framework across several metrics and models. Our aim is to enable safer deployment of LLMs in real-world healthcare applications. For reproducibility, we make our code publicly available at https://github.com/congboma/MedErrBench.
