Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study explores the effectiveness of two self-supervised pretraining paradigms—Masked Autoencoders (MAE) and Joint Embedding Predictive Architectures (JEPA)—for MRI-based disease detection, emphasizing the role of auxiliary objectives. By introducing a novel spectral-domain reconstruction loss for MAE and variance-covariance regularization for JEPA, the authors demonstrate that the choice of self-supervised objective significantly influences downstream performance across various disease detection tasks. The results reveal that MAE with spectral-domain supervision outperforms other methods, particularly when high-frequency anatomical structures are critical for discrimination, highlighting the importance of aligning pretraining objectives with task-specific characteristics.
Self-supervised learning in MRI can be dramatically enhanced by tailoring pretraining objectives to the specific structures of downstream tasks, with MAE showing superior performance when focused on high-frequency details.
Self-supervised foundation models have shown strong promise in medical imaging. However, existing MRI foundation-model studies have primarily emphasized segmentation and dense prediction tasks, while systematic investigation of self-supervised foundation models for MRI-based disease detection remains limited. In this work, we investigate two major self-supervised pretraining paradigms for MRI-based disease detection: reconstruction-based learning via Masked Autoencoders (MAE) and predictive representation learning via Joint Embedding Predictive Architectures (JEPA). We study the role of auxiliary objectives by introducing a novel spectral-domain reconstruction loss for MAE to enhance sensitivity to fine-grained anatomical structure, and by integrating variance--covariance regularization (VCR) within our JEPA framework to encourage decorrelated latent representations. Our models are pretrained on heterogeneous single-contrast MRI volumes in a contrast-agnostic setting, without modality concatenation. Across five downstream disease detection tasks, our results highlight the importance of self-supervised objective design for medical foundation model pretraining, demonstrating that the downstream benefit of each objective is determined by its relevance to the task's structure. Specifically, spectral regularization yields the largest improvements when the downstream discriminative signal is characterized by strong high-frequency anatomical structures, while covariance regularization is most beneficial when discriminative information spans multiple decorrelated feature dimensions. MAE with spectral-domain supervision consistently achieves superior downstream performance for MRI-based disease detection. These findings suggest that self-supervised objectives in medical imaging encode specific biases, and their downstream benefit is fundamentally conditioned on the task's structure.