Search papers, labs, and topics across Lattice.
The paper introduces Multi-Attention Integration Learning (MAIL) and Robust-MAIL networks to improve multimodal medical image analysis by addressing limitations in generalizability, computational cost, and adversarial robustness. MAIL uses a residual learning attention block for modality-specific patterns and a cross-attention module for shared representations, while Robust-MAIL adds random projection filters and modulated attention noise for adversarial defense. Evaluations across 20 datasets demonstrate that MAIL and Robust-MAIL outperform existing methods, achieving up to 9.34% performance gains and 78.3% computational cost reduction.
Multimodal medical image analysis gets a boost with MAIL and Robust-MAIL, achieving state-of-the-art performance while slashing computational costs and bolstering adversarial robustness.
Multimodal Fusion Learning (MFL), leveraging disparate data from various imaging modalities (e.g., MRI, CT, SPECT), has shown great potential for addressing medical problems such as skin cancer and brain tumor prediction. However, existing MFL methods face three key limitations: a) they often specialize in specific modalities, and overlook effective shared complementary information across diverse modalities, hence limiting their generalizability for multi-disease analysis; b) they rely on computationally expensive models, restricting their applicability in resource-limited settings; and c) they lack robustness against adversarial attacks, compromising reliability in medical AI applications. To address these limitations, we propose a novel Multi-Attention Integration Learning (MAIL) network, incorporating two key components: a) an efficient residual learning attention block for capturing refined modality-specific multi-scale patterns and b) an efficient multimodal cross-attention module for learning enriched complementary shared representations across diverse modalities. Furthermore, to ensure adversarial robustness, we extend MAIL network to design Robust-MAIL by incorporating random projection filters and modulated attention noise. Extensive evaluations on 20 public datasets show that both MAIL and Robust-MAIL outperform existing methods, achieving performance gains of up to 9.34% while reducing computational costs by up to 78.3%. These results highlight the superiority of our approaches, ensuring more reliable predictions than top competitors. Code: https://github.com/misti1203/MAIL-Robust-MAIL.
