Deep Learning-Assisted Segmentation and Classification of Brain Tumor Types on Magnetic Resonance and Surgical Microscope Images.

OBJECTIVE: The primary aim of this research was to harness the capabilities of deep learning to enhance neurosurgical procedures, focusing on accurate tumor boundary delineation and classification. Through advanced diagnostic tools, we aimed to offer surgeons a more insightful perspective during surgeries, improving surgical outcomes and patient care.

METHODS: The study deployed the Mask R-CNN architecture, leveraging its sophisticated features to process and analyze data from surgical microscope videos and preoperative MR images. Resnet101 and Resnet50 backbone networks are used in the Mask R-CNN method and experimental results are given. We subsequently tested its performance across various metrics, such as accuracy, precision, recall, DICE and JAC. Deep learning models were trained from MRI and surgical microscope images and the classification result obtained for each patient was combined with the weighted average.

RESULTS: The algorithm exhibited remarkable capabilities in distinguishing between meningiomas, metastases, and high-grade glial tumors. Specifically, for the Mask R-CNN Resnet 101 architecture, precision, recall, DICE, and JAC values were recorded as 96%, 93%, 91%, and 84%, respectively. Conversely, for the Mask R-CNN Resnet 50 architecture, these values stood at 94%, 89%, 89%, and 82%. Additionally, the model achieved an impressive DICE score range of 94-95% and an accuracy of 98% in pathology estimation.

CONCLUSION: As illustrated in our study, the confluence of deep learning with neurosurgical procedures marks a transformative phase in medical science. The results are promising, but they underscore diverse data sets' significance for training and refining these deep learning models.