Search papers, labs, and topics across Lattice.
This paper introduces a fully open-source pipeline, built with the \texttt{llm\_extractinator} framework and \texttt{qwen2.5-72b}, for longitudinal information extraction of cancer lesion data from radiology reports. The system extracts and links target, non-target, and new lesion data across multiple time points, adhering to RECIST criteria. Evaluation on 50 Dutch CT reports achieved high attribute-level accuracies (93.7-94.9%), demonstrating the potential of open-source LLMs for this task.
Open-source LLMs can now rival proprietary systems in extracting crucial cancer progression data from radiology reports, unlocking scalable analysis while preserving patient privacy.
Radiology reports capture crucial longitudinal information on tumor burden, treatment response, and disease progression, yet their unstructured narrative format complicates automated analysis. While large language models (LLMs) have advanced clinical text processing, most state-of-the-art systems remain proprietary, limiting their applicability in privacy-sensitive healthcare environments. We present a fully open-source, locally deployable pipeline for longitudinal information extraction from radiology reports, implemented using the \texttt{llm\_extractinator} framework. The system applies the \texttt{qwen2.5-72b} model to extract and link target, non-target, and new lesion data across time points in accordance with RECIST criteria. Evaluation on 50 Dutch CT Thorax/Abdomen report pairs yielded high extraction performance, with attribute-level accuracies of 93.7\% for target lesions, 94.9\% for non-target lesions, and 94.0\% for new lesions. The approach demonstrates that open-source LLMs can achieve clinically meaningful performance in multi-timepoint oncology tasks while ensuring data privacy and reproducibility. These results highlight the potential of locally deployable LLMs for scalable extraction of structured longitudinal data from routine clinical text.
