Search papers, labs, and topics across Lattice.
This paper introduces D3Seg, a brain tumor segmentation model robust to missing MRI modalities, which are common in clinical practice. D3Seg uses a Multi-hop Modality Graph Fusion (MMGF) to capture higher-order inter-modality dependencies and a diffusion-based imputation to compensate for missing T1ce representations. Experiments on the BraTS 2023 dataset show D3Seg improves Dice scores by 1.5-2.0% on enhancing tumor (ET) and around 1.0% on tumor core (TC) compared to SOTA models under various missing modality scenarios.
Brain tumor segmentation can now maintain accuracy even when crucial MRI data is missing, thanks to a novel diffusion-based imputation strategy.
Accurate brain tumor segmentation using multiparametric MRI is critical for effective treatment planning. However, in clinical settings, complete acquisition of all MRI sequences is not always possible. The absence of certain MRI modalities results in substantial performance degradation in existing segmentation methods, which typically rely on naive feature concatenation or direct fusion strategies. To address this limitation, we propose a novel segmentation model D3Seg which is designed to maintain stable performance under missing-modality settings. D3Seg introduces Multi-hop Modality Graph Fusion (MMGF) to model higher order inter-modality dependencies, a lightweight diffusion-based imputation mechanism to compensate for missing T1ce representations in latent space, and probability-space decision refinement to mitigate dominant class overconfidence and improve delineation of underrepresented tumor subregions. Extensive evaluation on BraTS 2023 dataset demonstrates that our D3Seg model consistently improves segmentation performance under missing modality configurations. The proposed model achieves approximately 1.5-2.0% Dice improvement on enhancing tumor (ET) and around 1.0% on tumor core (TC) across multiple missing modality configurations compared to the current state-of-the-art model, while maintaining computational efficiency.
