Search papers, labs, and topics across Lattice.
BrainFusionNet integrates Convolutional Neural Networks (CNNs), Vision Transformers (ViTs), and Gated Recurrent Units (GRUs) to enhance brain tumor detection in MRI images by effectively extracting local, global, and sequential features. The model achieves an impressive 98% accuracy on two publicly available MRI datasets, outperforming state-of-the-art CNNs like DenseNet121 and VGG16, which achieved a maximum accuracy of 96%. Additionally, the incorporation of explainable AI techniques such as SHAP, LIME, and GradCAM allows for visualization of decision-making processes, highlighting the importance of pixel intensity distributions in classification performance.
BrainFusionNet achieves 98% accuracy in brain tumor detection by uniquely combining CNNs, ViTs, and GRUs, revealing that pixel intensity distributions significantly influence deep learning performance.
The noise of Magnetic Resonance Imaging MRI poses challenges for Deep Learning DL when tumor boundaries are obscured tumor location and appearance are complex Therefore we develop BrainFusionNet that combines Convolutional Neural Networks CNNs Vision Transformers ViT and Gated Recurrent Units GRUs to extract spatial contextual and sequential features from MRI images for improved brain tumor classification Furthermore explainable AI such as SHAP LIME and GradCAM are integrated to visualise and highlight image regions that contribute to BrainFusionNets decisionmaking process The proposed BrainFusionNet model is evaluated on two publicly available MRI datasets Kfold validation suggests 98 accuracy on both datasets The model was compared with the six stateoftheart SOTA CNNs and transfer learning Among the SOTA CNNs DenseNet121 and VGG16 achieved the highest accuracy of 96 The novelty of BrainFusionNet is that the hybrid model effectively extracts local and global features from MRI images even in smallscale tumor regions and small tumor sizes The model has a balanced sequential CNN architecture to capture lowlevel and deeperlayer features a customized ViT that captures local features stabilizes gradient flow and reduces the risk of vanishing gradients during MRI image training The CNN and ViT outputs are fed into a GRU for final classification Furthermore we analyze pixel intensities to determine whether MRI image quality affects image classification Our findings are very novel in image interpretation as we found that the distribution of pixel intensities in MRI images affects DL performance
