Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces Structured PubMed, a dataset of over 23.2 million section-labeled biomedical abstracts derived from the complete PubMed database, addressing the challenge posed by the predominance of unstructured abstracts. By combining 5.9 million author-structured abstracts with 17.2 million automatically labeled ones using a Large Language Model, the dataset facilitates enhanced information retrieval and text mining. The unified five-section schema enables researchers to train models for sentence classification and benchmark text-segmentation tasks at an unprecedented scale.
Over 23 million biomedical abstracts are now structured for improved text mining and information retrieval, unlocking new research possibilities.
Structured abstracts are important for biomedical literature processing, by facilitating information retrieval, text mining, and knowledge synthesis. However, a vast portion of abstracts indexed in PubMed remain unstructured, presenting a significant bottleneck for downstream text-processing workflows and applications. To resolve this limitation, we introduce Structured PubMed, a comprehensive corpus of section-labeled biomedical abstracts compiled from the complete PubMed database, encompassing over 23.2 million research-article records. The corpus is divided into two distinct subsets: a collection of 5.9 million author-structured abstracts parsed from official XML files, and an automatically labeled collection of 17.2 million originally unstructured abstracts structured via a verbatim-extraction Large Language Model pipeline. Every record is harmonized under a unified five-section schema and mapped to its original PubMed identifier, publication type, and publication date. This dataset can be utilized to train sentence-classification models, benchmark text-segmentation architectures, and perform large-scale, section-specific information extraction at an unprecedented PubMed-wide scale.