Search papers, labs, and topics across Lattice.
Meta-D is introduced, an architecture that explicitly incorporates categorical scanner metadata (MRI sequence and plane orientation) to guide feature extraction in brain tumor analysis. By dynamically modulating convolutional features based on sequence and plane metadata, Meta-D achieves up to a 2.62% absolute increase in F1-score for 2D tumor detection compared to image-only baselines. Furthermore, a Transformer Maximizer module leverages metadata-based cross-attention to handle missing modalities in 3D tumor segmentation, improving Dice scores by up to 5.12% under extreme modality scarcity while reducing model parameters by 24.1%.
Explicitly injecting MRI sequence and plane metadata into deep learning architectures for brain tumor analysis yields significant performance gains in both tumor detection and segmentation, even when modalities are missing.
We present Meta-D, an architecture that explicitly leverages categorical scanner metadata such as MRI sequence and plane orientation to guide feature extraction for brain tumor analysis. We aim to improve the performance of medical image deep learning pipelines by integrating explicit metadata to stabilize feature representations. We first evaluate this in 2D tumor detection, where injecting sequence (e.g., T1, T2) and plane (e.g., axial) metadata dynamically modulates convolutional features, yielding an absolute increase of up to 2.62% in F1-score over image-only baselines. Because metadata grounds feature extraction when data are available, we hypothesize it can serve as a robust anchor when data are missing. We apply this to 3D missing-modality tumor segmentation. Our Transformer Maximizer utilizes metadata-based cross-attention to isolate and route available modalities, ensuring the network focuses on valid slices. This targeted attention improves brain tumor segmentation Dice scores by up to 5.12% under extreme modality scarcity while reducing model parameters by 24.1%.
