Search papers, labs, and topics across Lattice.
This paper presents a novel approach for training a text-conditioned segmentation model for CT scans by integrating voxel-level supervision with scalable slice-level supervision derived from clinical reports. By extracting findings and their corresponding slice indices from a large database of scan-report pairs, the authors finetune the SAM3 segmentation model using both strong and weak supervision. The method achieves significant improvements in segmentation accuracy, with a relative gain in dice score of 22% when using only 250 fully labeled volumes, highlighting the effectiveness of weak supervision in medical imaging tasks.
Leveraging weak supervision from clinical reports boosts CT scan segmentation accuracy by up to 22% with minimal labeled data.
We introduce a method for training a text-conditioned segmentation model for CT scans, which combines voxel-level supervision with coarse but scalable slice-level supervision from reports. We extract, from a large database of scan-report pairs, descriptions of findings with indices of slices where those findings occur. We then finetune a general-purpose 2D image segmentation model, SAM3, with standard segmentation losses from strongly labeled data and with a slice-level classification loss from the extracted weak supervision. Our results on the ReXGroundingCT dataset illustrate that this strategy improves the segmentation dice score: from an 8% relative gain when there are 1000 fully labeled volumes to 22% when there are 250 fully labeled volumes.
BAIR