Summary: A new artificial intelligence convolutional neural network is 94.6% accurate at diagnosing real-time intraoperative brain tumors.
Source: NYU Langone Health
A novel method of combining advanced optical imaging with an artificial intelligence algorithm produces accurate, real-time intraoperative diagnosis of brain tumors, a new study finds.
Published in Nature Medicine on January 6, the study examined the diagnostic accuracy of brain tumor image classification through machine learning, compared with the accuracy of pathologist interpretation of conventional histologic images. The results for both methods were comparable: the AI-based diagnosis was 94.6% accurate, compared with 93.9% for the pathologist-based interpretation.
The imaging technique, stimulated Raman histology (SRH), reveals tumor infiltration in human tissue by collecting scattered laser light, illuminating essential features not typically seen in standard histologic images.
The microscopic images are then processed and analyzed with artificial intelligence, and in under two and a half minutes, surgeons are able to see a predicted brain tumor diagnosis. Using the same technology, after the resection, they are able to accurately detect and remove otherwise undetectable tumor.
“As surgeons, we’re limited to acting on what we can see; this technology allows us to see what would otherwise be invisible, to improve speed and accuracy in the OR, and reduce the risk of misdiagnosis,” says senior author Daniel A. Orringer, MD, associate professor of Neurosurgery at NYU Grossman School of Medicine, who helped develop SRH and co-led the study with colleagues at the University of Michigan. “With this imaging technology, cancer operations are safer and more effective than ever before.”
How the Study Was Conducted
To build the artificial intelligence tool used in the study, researchers trained a deep convolutional neural network (CNN) with more than 2.5 million samples from 415 patients to classify tissue into 13 histologic categories that represent the most common brain tumors, including malignant glioma, lymphoma, metastatic tumors, and meningioma.
In order to validate the CNN, researchers enrolled 278 patients undergoing brain tumor resection or epilepsy surgery at three university medical centers in the prospective clinical trial. Brain tumor specimens were biopsied from patients, split intraoperatively into sister specimens, and randomly assigned to the control or experimental arm.
Specimens routed through the control arm–the current standard practice–were transported to a pathology laboratory and went through specimen processing, slide preparation by technicians, and interpretation by pathologists, a process which takes 20-30 minutes. The experimental arm was performed intraoperatively, from image acquisition and processing to diagnostic prediction via CNN.
Notably, the diagnostic errors in the experimental group were unique from the errors in the control group, suggesting that a pathologist using the novel technique could achieve close to 100% accuracy. The system’s precise diagnostic capacity could also be beneficial to centers that lack access to expert neuropathologists.
“SRH will revolutionize the field of neuropathology by improving decision-making during surgery and providing expert-level assessment in the hospitals where trained neuropathologists are not available,” says Matija Snuderl, MD, associate professor in the Department of Pathology at NYU Grossman School of Medicine and a co-author of the study.
NYU Langone’s Brain and Spine Tumor Center Offers Cutting-Edge Treatment
Dr. Orringer joined NYU Langone in August 2019, bringing with him the SRH technology he helped to develop. NYU Langone’s Brain and Spine Tumor Center is the first to offer this technique, using Invenio’s NIO Laser Imaging System, in the Northeast.
The newest addition to the center’s comprehensive suite of neurosurgical imaging technologies, SRH works in concert with intraoperative MRI and fluorescence-guided surgery to provide high-resolution precision guidance for NYU Langone’s world-class neurosurgeons.
“NYU Langone’s Department of Neurosurgery has long been a leader in bringing the most advanced treatment options to our patients,” says John G. Golfinos, MD, Joseph P. Ransohoff Professor of neurology and chair of the Department of Neurosurgery. “With the addition of Dr. Orringer’s expertise and this game-changing technology, we’re now even better equipped to provide safe surgeries and quality outcomes for the most complex brain tumor cases.”
The implementation of this new system is the most recent of NYU Langone’s efforts to integrate artificial intelligence in clinical practice to improve diagnostics of cancer. Researchers and clinicians at NYU Langone’s Perlmutter Cancer Center have made recent strides in lung cancer, breast cancer, and brain tumor.
Source:
NYU Langone Health
Media Contacts:
Annie Harris – NYU Langone Health
Image Source:
The image is credited to Daniel Orringer, NYU Langone Health.
Original Research: Open access
“Near real-time intraoperative brain tumor diagnosis using stimulated Raman histology and deep neural networks”. Daniel Orringer et al.
Nature Medicine doi:10.1038/s41591-019-0715-9.
Abstract
Near real-time intraoperative brain tumor diagnosis using stimulated Raman histology and deep neural networks
Intraoperative diagnosis is essential for providing safe and effective care during cancer surgery1. The existing workflow for intraoperative diagnosis based on hematoxylin and eosin staining of processed tissue is time, resource and labor intensive2,3. Moreover, interpretation of intraoperative histologic images is dependent on a contracting, unevenly distributed, pathology workforce4. In the present study, we report a parallel workflow that combines stimulated Raman histology (SRH)5,6,7, a label-free optical imaging method and deep convolutional neural networks (CNNs) to predict diagnosis at the bedside in near real-time in an automated fashion. Specifically, our CNNs, trained on over 2.5 million SRH images, predict brain tumor diagnosis in the operating room in under 150 s, an order of magnitude faster than conventional techniques (for example, 20–30 min)2. In a multicenter, prospective clinical trial (n = 278), we demonstrated that CNN-based diagnosis of SRH images was noninferior to pathologist-based interpretation of conventional histologic images (overall accuracy, 94.6% versus 93.9%). Our CNNs learned a hierarchy of recognizable histologic feature representations to classify the major histopathologic classes of brain tumors. In addition, we implemented a semantic segmentation method to identify tumor-infiltrated diagnostic regions within SRH images. These results demonstrate how intraoperative cancer diagnosis can be streamlined, creating a complementary pathway for tissue diagnosis that is independent of a traditional pathology laboratory.
