Search papers, labs, and topics across Lattice.
This paper introduces a multi-agent framework designed to mitigate premature diagnostic handoff and silent clinical hallucinations in healthcare applications by implementing deterministic orchestration constraints. The framework utilizes a neuro-symbolic state-tracking gate to ensure the completeness of the OLDCARTS clinical protocol and an epistemic uncertainty quantification gate to assess semantic entropy across multiple diagnostic samples. Evaluation on simulated patient agents reveals a diagnostic precision of 49.3%, marking an 11.3 percentage point improvement over a baseline, while also indicating a significant relationship between structured information gathering and reduced diagnostic uncertainty.
A multi-agent framework boosts diagnostic precision by over 11% while tackling critical failure modes in AI-driven healthcare.
Recent advances in Large Language Models (LLMs) and multi-agent systems have driven the rise of Agentic AI, showing promise for medical reasoning. However, open-ended conversational agents remain prone to two critical failure modes: premature diagnostic handoff and silent clinical hallucinations that may go undetected before reaching the patient. In this work, we propose a multi-agent framework that addresses both issues by replacing ``LLM-as-a-judge'' routing with deterministic orchestration constraints. The framework incorporates two safety mechanisms. First, a neuro-symbolic state-tracking gate enforces completeness of the OLDCARTS clinical protocol (Onset, Location, Duration, Character, Aggravating/Alleviating factors, Radiation, Timing, and Severity) by blocking diagnostic transitions until all required dimensions are collected. Second, an epistemic uncertainty quantification (UQ) gate computes semantic entropy (H) across K=5 independent diagnostic samples to identify and intercept divergent outputs before delivery. We evaluate the system using simulated patient agents powered by the llama-3.1-70b-instruct model on 150 test cases. The full architecture achieves 49.3% diagnostic precision, representing an absolute improvement of 11.3 percentage points over an unconstrained baseline. Additionally, we observe a statistically significant negative correlation (r = -0.181, p < 0.05) between OLDCARTS completeness (蟽) and semantic entropy (H), suggesting that structured information gathering is associated with reduced diagnostic uncertainty.
