Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study establishes a clinical provenance categorization pipeline using supervised fine-tuning of Llama-3 models to enhance the summarization of multidisciplinary insights in high-complexity settings like the NICU. By fine-tuning both 8B and 70B models on a corpus of MIMIC-III notes, the authors achieved impressive Macro F1 scores exceeding 92%, with the 70B model showing a significant 7% improvement in cross-domain generalization. The results highlight the importance of model capacity for effective semantic transfer and demonstrate that quantized models can outperform their full-precision counterparts while reducing computational demands.
Fine-tuning a 70B model not only boosts performance in clinical provenance categorization but also shows that quantization can enhance efficiency without sacrificing accuracy.
Effective "all-team" summarization in high-complexity settings like the Neonatal Intensive Care Unit (NICU) requires aggregating insights from diverse disciplines (physicians, nurses, therapists) spread across hundreds of clinical free-text notes. Simply pooling heterogeneous text often leads to incoherent outputs. Structured summarization therefore first requires accurate categorization of sentence-level provenance across multi-source notes. This pilot study introduces a clinical provenance categorization pipeline using supervised fine-tuning (SFT) of large language models (LLMs). We adapted two Llama-3 models (8B and 70B) to MedSecId, a corpus of 2,002 MIMIC-III (Adult ICU) notes annotated with clinical provenance headers, achieving in-domain Macro F1 scores above 92% for both models. To evaluate cross-domain generalization, we assessed model capacity (8B vs. 70B) and quantization on a gold-standard dataset of 227 sentence-level spans derived from three multi-disciplinary NICU summaries. Experimental results demonstrate a scale-dependent transfer effect: while SFT produced only marginal changes for the 8B model, it substantially improved the 70B model, increasing Macro F1 by 7%. Notably, the quantized fine-tuned 70B model outperformed its full-precision baseline while substantially reducing computational requirements. These findings suggest that sufficient model capacity is critical for preserving semantic flexibility during cross-domain clinical transfer and that efficient quantized adaptation can enable structured provenance modeling for downstream summarization.