Search papers, labs, and topics across Lattice.
This study introduces Biased Masked Image Modeling (B-MIM), a novel approach that modifies the iBOT objective to enhance the sensitivity of CT encoders to fine-grained anatomical structures by reducing global semantic alignment in favor of local patch reconstruction. By utilizing a multi-institutional dataset of 9,955 CT studies, the authors pretrained a 3D Swin Transformer backbone, demonstrating significant improvements in topological fidelity and competitive performance in liver vessel and tumor segmentation tasks. The findings indicate that this bias in pretraining can lead to better generalization for intricate anatomical details, crucial for accurate medical imaging analysis.
Reducing global semantic pressure during pretraining can significantly enhance the segmentation of fine-grained anatomical structures in medical imaging.
Self-supervised pretraining enables transferable representations for medical imaging, yet most CT encoders remain biased toward coarse semantic understanding, limiting their sensitivity to fine-grained anatomical structures such as vessels or small tumors. In this paper, we introduce Biased Masked Image Modeling (B-MIM), a modification of the iBOT objective that stochastically reduces global semantic alignment to prioritize local patch reconstruction. This bias encourages the encoder to capture high-frequency morphological details and structural continuity. We curate a multi-institutional CT abdominal dataset of 9,955 filtered studies from 17 public sources and pretrain a 3D Swin Transformer backbone using B-MIM. Across inter-dataset experiments on liver vessel segmentation, the proposed encoder improves topological fidelity (clDice) and achieves competitive Dice scores in tumor segmentation, compared to fully fine-tuned baselines, despite updating only a fraction of the parameters. Our results suggest that reducing global semantic pressure during pretraining enhances generalization to intricate anatomical structures.
