Enhancing brain tumor classification through ensemble attention mechanism

Brain tumors pose a serious threat to public health, impacting thousands of individuals directly or indirectly worldwide. Timely and accurate detection of these tumors is crucial for effective treatment and enhancing the quality of patients’ lives. The widely used brain imaging technique is magnetic resonance imaging, the precise identification of brain tumors in MRI images is challenging due to the diverse anatomical structures. This paper introduces an innovative approach known as the ensemble attention mechanism to address this challenge. Initially, the approach uses two networks to extract intermediate- and final-level feature maps from MobileNetV3 and EfficientNetB7. This assists in gathering the relevant feature maps from the different models at different levels. Then, the technique incorporates a co-attention mechanism into the intermediate and final feature map levels on both networks and ensembles them. This directs attention to certain regions to extract global-level features at different levels. Ensemble of attentive feature maps enabling the precise detection of various feature patterns within brain tumor images at both model, local, and global levels. This leads to an improvement in the classification process. The proposed system was evaluated on the Figshare dataset and achieved an accuracy of 98.94%, and 98.48% for the BraTS 2019 dataset which is superior to other methods. Thus, it is robust and suitable for brain tumor detection in healthcare systems.