Search papers, labs, and topics across Lattice.
This paper addresses clinical section segmentation by creating a new obstetrics notes dataset and comparing supervised transformer models against zero-shot large language models. They evaluated the performance of supervised models trained on MIMIC-III both in-domain and on the new out-of-domain obstetrics dataset. The key finding is that while supervised models excel in-domain, zero-shot models exhibit better out-of-domain adaptability after correcting for hallucinated section headers.
Zero-shot LLMs can segment clinical notes in new domains better than fine-tuned models, but only after you fix their header hallucinations.
Clinical free-text notes contain vital patient information. They are structured into labelled sections; recognizing these sections has been shown to support clinical decision-making and downstream NLP tasks. In this paper, we advance clinical section segmentation through three key contributions. First, we curate a new de-identified, section-labeled obstetrics notes dataset, to supplement the medical domains covered in public corpora such as MIMIC-III, on which most existing segmentation approaches are trained. Second, we systematically evaluate transformer-based supervised models for section segmentation on a curated subset of MIMIC-III (in-domain), and on the new obstetrics dataset (out-of-domain). Third, we conduct the first head-to-head comparison of supervised models for medical section segmentation with zero-shot large language models. Our results show that while supervised models perform strongly in-domain, their performance drops substantially out-of-domain. In contrast, zero-shot models demonstrate robust out-of-domain adaptability once hallucinated section headers are corrected. These findings underscore the importance of developing domain-specific clinical resources and highlight zero-shot segmentation as a promising direction for applying healthcare NLP beyond well-studied corpora, as long as hallucinations are appropriately managed.
