Search papers, labs, and topics across Lattice.
This paper presents a two-stage local pipeline for filling Case Report Forms (CRFs) from unstructured electronic health record (EHR) notes, addressing privacy concerns and inference costs associated with large language models (LLMs). By utilizing the MedGemma-27B model, the authors implemented a method that separates binary presence classification from value extraction, ensuring outputs are strictly based on textual evidence. The approach achieved a macro-F1 score of 0.55, ranking second among local, open-source submissions, demonstrating the viability of privacy-preserving LLMs in clinical settings.
Privacy-preserving LLMs can rival proprietary models in clinical NLP, achieving competitive performance without compromising patient data.
The extraction of structured clinical information from unstructured EHR notes is a persistent bottleneck in healthcare informatics. While large language models (LLMs) offer high performance, their deployment in clinical settings is hindered by privacy risks, inference costs, and the tendency to hallucinate beyond textual evidence. We address these challenges for the CL4Health 2026 Case Report Form (CRF) filling task by proposing a fully local, domain-adapted pipeline using the MedGemma-27B model. Our two-stage architecture, which separates binary presence classification from value extraction, enforces strict adherence to textual evidence and ensures deterministic outputs for negated, uncertain, or unknown states. By leveraging item-specific, few-shot in-context learning without external API calls or fine-tuning, our approach achieves a macro-F1 score of 0.55 on the official English test track. This result secures second place among all locally-hosted, open-source submissions. Our work demonstrates that privacy-preserving, on-premise LLM pipelines can achieve near-competitive performance with proprietary frontier models, providing a practical, data-sovereign framework for clinical NLP.