Search papers, labs, and topics across Lattice.
This study presents a modular framework that leverages Large Language Models (LLMs) to perform conformance checking in stroke care without relying on formal Computer-Interpretable Guidelines (CIGs). By extracting patient traces from clinical discharge letters and translating normative rules from unstructured clinical texts into executable scripts, the framework successfully assessed compliance against 50 guideline rules. The implementation at Alessandria Hospital revealed that over 86% of patient traces were conformant, highlighting the framework's effectiveness in real-world healthcare settings.
Orchestrated LLMs can achieve over 86% compliance in stroke care conformance checking without needing formal guidelines.
Objective: Conformance checking in healthcare seeks to assess whether patient care pathways adhere to clinical guidelines. However, its practical application often depends on the availability of formal, machine-interpretable representations of guidelines, such as Computer-Interpretable Guidelines (CIGs), which are seldom available in real-world clinical settings. Methods: This work introduces a modular framework based on the orchestration of Large Language Models (LLMs) to support medical conformance checking directly from unstructured clinical and guideline texts, without requiring predefined CIGs. The proposed architecture integrates multiple LLMs and supporting components to extract patient traces from clinical discharge letters, identify normative rules from textual clinical guidelines, translate these rules into executable scripts, and compute a Trace Conformance Indicator to quantify compliance within the event log. Results: The framework was implemented and evaluated in the stroke care domain at the neurological ward of Alessandria Hospital. Hundreds of patient traces were automatically extracted from hospital data and assessed against 50 rules derived from the reference guideline. The analysis showed that more than 86\% of the available traces were conformant. Conclusion: The results demonstrate the feasibility of using orchestrated LLMs for practical healthcare conformance analysis. At the same time, the study provides evidence of a high level of adherence to stroke care guidelines at Alessandria Hospital.
