Search papers, labs, and topics across Lattice.
This study developed ICU-REACT, a reasoning dataset created with input from 19 clinicians, to enhance large language models (LLMs) in clinical decision-making within the intensive care unit (ICU). By fine-tuning Clin-REACT models ranging from 8B to 70B parameters, the researchers demonstrated significant improvements in clinical reasoning across five benchmarks, outperforming both backbone models and existing medical LLMs. The results indicate that incorporating expert reasoning into LLM training can enhance reasoning capabilities beyond critical care contexts, although further evaluation is required for practical application.
Training LLMs with expert ICU reasoning leads to significant improvements in clinical decision-making across diverse medical tasks.
Clinical decision-making relies on identifying relevant patient information to guide diagnosis and treatment, a challenge that is especially difficult in the data-dense and rapidly changing intensive care unit (ICU). Large language models (LLMs) could support this task. However, existing applications and datasets mostly emphasize surface-level retrieval or factual recall rather than the inductive and deductive reasoning clinicians practice to select and reason over decision-relevant evidence. We hypothesized that training LLMs on expert ICU reasoning could yield clinical reasoning skills that generalize beyond critical care. Here we introduce ICU-REACT, a reasoning dataset developed with 19 clinicians through a clinician-in-the-loop framework to teach LLMs to perform information retrieval and context-aware clinical reasoning in the ICU. Using ICU-REACT, we fine-tuned Clin-REACT models spanning 8B-70B parameters and three model families. Across five clinical reasoning benchmarks, Clin-REACT consistently outperformed its backbone models and open-source general-purpose and medical LLMs. Gains extended to different tasks including script concordance tests, and downstream diagnosis and treatment tasks. These findings suggest that expert reasoning supervision in critical care can improve broader clinical reasoning, although prospective evaluation is needed before real-world clinical use.
