Search papers, labs, and topics across Lattice.
This paper addresses the challenge of managing uncertainty in LLM-based multi-agent systems, particularly in safety-critical domains like echocardiography, by proposing a lifecycle-based uncertainty management framework. The framework differentiates between epistemological and ontological uncertainties and incorporates mechanisms for representation, identification, evolution, and adaptation of these uncertainties across the system's architecture and execution phases. The authors demonstrate the framework's effectiveness using a real-world echocardiographic system, showing improvements in reliability and diagnosability.
LLM-based multi-agent systems in healthcare can be made more reliable and diagnosable by explicitly modeling and managing uncertainty throughout the system lifecycle, not just at the model level.
Applying LLM-based multi-agent software systems in safety-critical domains such as lifespan echocardiography introduces system-level risks that cannot be addressed by improving model accuracy alone. During system operation, beyond individual LLM behavior, uncertainty propagates through agent coordination, data pipelines, human-in-the-loop interaction, and runtime control logic. Yet existing work largely treats uncertainty at the model level rather than as a first-class software engineering concern. This paper approaches uncertainty from both system-level and runtime perspectives. We first differentiate epistemological and ontological uncertainties in the context of LLM-based multi-agent software system operation. Building on this foundation, we propose a lifecycle-based uncertainty management framework comprising four mechanisms: representation, identification, evolution, and adaptation. The uncertainty lifecycle governs how uncertainties emerge, transform, and are mitigated across architectural layers and execution phases, enabling structured runtime governance and controlled adaptation. We demonstrate the feasibility of the framework using a real-world LLM-based multi-agent echocardiographic software system developed in clinical collaboration, showing improved reliability and diagnosability in diagnostic reasoning. The proposed approach generalizes to other safety-critical LLM-based multi-agent software systems, supporting principled operational control and runtime assurance beyond model-centric methods.
