Search papers, labs, and topics across Lattice.
The paper introduces FEEDS (Foundation model-Enabled Efficient Data Sampling), a novel training strategy that leverages vision foundation model embeddings to optimize the selection of unlabeled PET/CT cases for expert annotation, significantly reducing the need for extensive labeled datasets. By employing this label- and compute-efficient approach, FEEDS achieves high accuracy and generalizability across multiple cancer types and imaging tracers, demonstrating performance comparable to fully-labeled models while requiring 70% less annotation effort. The method was validated using the AutoPET-III dataset and tested on additional datasets, showcasing its effectiveness in clinical applications for lesion segmentation.
Achieving fully-labeled model performance with 70% less annotation effort could revolutionize automated cancer detection in PET/CT imaging.
Automated lesion segmentation in whole-body PET/CT imaging can assist clinicians with cancer detection, staging, and treatment planning across radiotracers and cancer types. However, training lesion segmentation models that capture variations in lesion size, distribution, and appearance requires large annotated datasets, whose creation is both time- and expertise-intensive. As a result, models trained on limited labeled PET/CT data often lack the accuracy and generalizability needed for clinical use. We present FEEDS (Foundation model-Enabled Efficient Data Sampling), a label- and compute-efficient learning strategy that uses vision foundation model embeddings to select the most informative and diverse unlabeled cases for expert annotation. Unlike unsupervised, semi-supervised, and active learning approaches, FEEDS is a one-step training paradigm requiring only a limited, representative training set, making it label- and compute-efficient. We train and validate FEEDS using the AutoPET-III dataset. We test its accuracy and generalizability on three held-out sets: AutoPET-III, DeepPSMA, and an internal Dartmouth-Hitchcock Medical Center dataset. We evaluate clinical utility at the voxel, lesion, and anatomic region level to assess performance in high-risk areas and treatment planning utility. FEEDS outperforms random-sampling-based labeling, pseudolabel-based semi-supervised learning, and training with limited labeled data alone. It generalizes across all three test sets, FDG and PSMA tracers, and multiple diseases, matching fully-labeled (100\%) training performance with 70\% less annotation burden. FEEDS addresses the challenge of label scarcity in an automatic lesion segmentation framework by providing a practical approach for constructing representative and diverse annotation queues from large, unannotated clinical repositories.
