Search papers, labs, and topics across Lattice.
The paper introduces IPnP, an iterative prompting and pseudo-labeling framework, to address the challenge of partially labeled data in medical image segmentation. IPnP leverages a frozen foundation model as a generalist to guide a trainable segmentation network (specialist) in generating and refining pseudo-labels for unlabeled organs. Experiments on AMOS and a private head-and-neck cancer dataset show that IPnP improves segmentation performance over existing methods and approaches fully supervised performance in the partially labeled setting.
Foundation models can fill in the gaps in partially labeled medical image datasets, enabling segmentation performance competitive with fully supervised training.
Automated medical image segmentation has achieved remarkable progress with fully labeled data. However, site-specific clinical priorities and the high cost of manual annotation often yield scans with only a subset of organs labeled, leading to the partially labeled problem that degrades performance. To address this issue, we propose IPnP, an Iteratively Prompting and Pseudo-labeling framework, for partially labeled medical image segmentation. IPnP iteratively generates and refines pseudo-labels for unlabeled organs through collaboration between a trainable segmentation network (specialist) and a frozen foundation model (generalist), progressively recovering full-organ supervision. On the public dataset AMOS with the simulated partial-label setting, IPnP consistently improves segmentation performance over prior methods and approaches the performance of the fully labeled reference. We further evaluate on a private, partially labeled dataset of 210 head-and-neck cancer patients and demonstrate our effectiveness in real-world clinical settings.