Search papers, labs, and topics across Lattice.
This study introduces the Multi-window Mixture-of-Head Attention Transformer (MMA-Former), designed for the non-invasive prediction of perineural invasion (PNI) in cholangiocarcinoma using 3D MRI scans. The architecture employs a Coarse-Fine Transformer structure combined with a Window-Specific Mixture-of-Head attention mechanism, allowing for efficient multi-scale feature extraction that adapts to the local context of each 3D window. Evaluation on a dataset of 168 T1-weighted MRI scans demonstrated that MMA-Former achieved an AUC of 0.752, surpassing both CNN and Transformer baselines in performance.
MMA-Former's innovative attention mechanism enables spatially adaptive feature extraction, significantly improving PNI prediction accuracy from 3D MRI scans.
Perineural invasion (PNI) is a critical prognostic factor in cholangiocarcinoma. Non-invasive prediction from 3D MRI is challenging, demanding models that efficiently capture both fine-grained details and global context. We propose the Multi-window Mixture-of-Head Attention Transformer (MMA-Former), a novel end-to-end 3D architecture featuring a Coarse-Fine Transformer (CFT) structure for parallel multi-scale feature extraction. We advance this structure by integrating a novel Window-Specific Mixture-of-Head attention (WS-MoH) mechanism. Unlike standard Multi-Head Self Attention (MSA), WS-MoH generates a representation for each 3D window and dynamically routes the entire window to specialized or common attention heads. This enables spatially adaptive feature extraction tailored to the local context of each window, enhancing specialization and reducing redundancy without increasing parameters. Evaluated on a retrospective dataset of 168 T1-weighted MRI scans, MMA-Former achieved an AUC of 0.752, outperforming other 3D architectures, including the best CNN (AUC of 0.708) and Transformer baselines (AUC of 0.681).
NVIDIA