Search papers, labs, and topics across Lattice.
This study introduces a 3D multimodal deep learning framework designed for the classification of paramagnetic rim lesions (Rim$^+$) in Multiple Sclerosis using Quantitative Susceptibility Mapping (QSM) and FLAIR MRI. By addressing the challenges of class imbalance and the limitations of visual assessment, the model employs self-supervised multimodal pretraining followed by supervised fine-tuning with contrastive regularization to enhance robustness. The results demonstrate a significant performance improvement over previous architectures, underscoring the potential of asymmetric modeling in automated lesion identification.
Asymmetric modeling in deep learning can dramatically enhance the automated identification of chronic active lesions in Multiple Sclerosis, outperforming traditional methods.
Paramagnetic rim lesions (Rim$^+$) identified on susceptibility-sensitive MRI have recently emerged as a specific biomarker of chronic active inflammation in Multiple Sclerosis (MS) and are associated with long-term disability progression. However, susceptibility imaging and expert interpretation remain limited to specialized centers, visual assessment is time-consuming and variable, and the low prevalence of Rim$^+$ lesions poses severe class imbalance challenges for automated analysis. We propose a 3D multimodal deep learning framework for lesion-level Rim$^+$/Rim$^-$ classification from Quantitative Susceptibility Mapping (QSM) and FLAIR MRI. The architecture explicitly models modality asymmetry by treating QSM as the primary susceptibility-driven signal and conditioning it with FLAIR-derived structural context. To improve robustness under limited data, we employ self-supervised multimodal pretraining followed by supervised fine-tuning with contrastive regularization. The method was evaluated on a clinically acquired cohort of 88 people with MS with expert lesion annotations as reference standard. Results highlight improved performance compared to prior architectures, supporting the effectiveness of asymmetric multimodal modeling for automated chronic active lesion identification.
