Search papers, labs, and topics across Lattice.
This study introduces ClaMPAPP, a hybrid system that leverages large language models (LLMs) as interfaces to extract clinical features from narrative texts while employing a structured machine-learning model (XGBoost) for risk prediction in pediatric appendicitis. By validating features through deterministic plausibility checks, ClaMPAPP outperformed traditional end-to-end LLM approaches in diagnostic accuracy and minimized missed appendicitis cases. The findings highlight the advantages of separating natural language processing from predictive inference, enhancing both usability and safety in clinical decision support systems.
ClaMPAPP achieves superior diagnostic performance in pediatric appendicitis by combining LLMs for feature extraction with a robust machine-learning classifier, challenging the efficacy of end-to-end LLMs in clinical settings.
Large language models (LLMs) can make clinical decision support more accessible by interpreting free-text documentation, but their direct use as diagnostic engines is limited by sensitivity to prompts, information order, and plausible but incorrect outputs. Structured machine-learning models offer more stable risk prediction, yet they require tabular inputs that are difficult to integrate with narrative clinical workflows. We present ClaMPAPP (Clinical Language-assisted Machine-learning Pipeline for Appendicitis), a hybrid system that uses an LLM as an interface rather than as the final decision-maker. ClaMPAPP extracts schema-constrained clinical features from note-like narratives, applies deterministic plausibility checks, and passes validated features to an XGBoost classifier trained on clinical, laboratory, and ultrasound variables. We evaluated ClaMPAPP on two independent pediatric appendicitis cohorts from German hospitals and compared it with end-to-end LLM baselines, including open-source and proprietary models. To preserve ground truth while testing free-text input, narratives were generated from structured electronic health records through template rendering and constrained LLM rewriting, with additional sentence-order permutation to assess positional robustness. ClaMPAPP achieved the strongest overall diagnostic performance in both internal and external validation while minimizing missed appendicitis cases, the key safety concern in acute triage. End-to-end LLMs showed unstable sensitivity-specificity trade-offs and greater degradation under narrative reordering. These results support an LLM-as-interface, ML-as-predictor design that separates natural-language usability from predictive inference and provides a more auditable pathway for clinical decision support.
