Search papers, labs, and topics across Lattice.
This paper introduces Spatio-Temporal Mixture-of-Modality-Experts (ST-MoME), a conditional diffusion framework that synthesizes quantitative DCE-MRI maps from incomplete multimodal MRI data. By employing a spatio-temporal gating network to dynamically weight modality-specific expert features, ST-MoME effectively addresses the challenges posed by missing data in clinical settings. Evaluated on a cohort of 386 brain tumor patients, ST-MoME demonstrates superior performance in reconstructing DCE parameters, particularly in tumor regions, achieving the lowest mean Normalized Mean Square Error across various modality-availability scenarios.
ST-MoME achieves unprecedented accuracy in synthesizing DCE-MRI maps from incomplete data, outperforming existing methods in clinically critical tumor regions.
Quantitative maps from dynamic contrast-enhanced MRI (DCE-MRI) are essential for tumor assessment but are often unavailable due to contrast-agent risks and protocol variability. Prior methods predict these maps from other MRI modalities, yet most assume fixed, fully observed inputs and fail under realistic missingness. We present Spatio-Temporal Mixture-of-Modality-Experts (ST-MoME), a conditional diffusion framework that synthesizes 3D DCE parameter maps from diverse subsets of multimodal MRI. ST-MoME fuses modality-specific expert features through a spatio-temporal gating network that produces voxel-wise, timestep-dependent weights, forming a conditioning tensor that guides denoising. To preserve quantitative fidelity, ST-MoME performs diffusion directly in image space with 3D patch-based training and a Swin-based backbone. On a clinical brain-tumor cohort of 386 patients, we evaluate ST-MoME across 16 controlled modality-availability scenarios. It achieves the lowest mean Normalized Mean Square Error (NMSE) aggregated across all three DCE parameters, with leading performance on $v_p$ and $v_e$, competitive results on $K^{\mathrm{trans}}$, and the lowest reconstruction error within the clinically critical tumor region. A post-hoc analysis of the learned gating dynamics shows a structural-early, physiological-late fusion schedule consistent with clinical intuition.
