Summary: A novel deep learning method that uses graph convolutional neural networks (gCNNs) can predict cognitive function based on the brain’s size and structure. The algorithm may provide insights into the relationship between brain morphology and different cognitive functions, as well as declines in cognitive function.
Source: Northwestern University
Northwestern investigators have developed a deep learning-based method that can predict cognitive function capacity based on brain shape and structure, detailed in a study published in Scientific Reports.
The method, which uses graph convolutional neural networks (gCNNs), may also reveal new insights into the relationship between brain morphology and different cognitive functions as well as the decline of brain function.
“When we apply the rich capabilities of CNNs to graph representation of the brain, we can explore the brain as an image in a previously unexplored way,” said S. Kathleen Bandt, MD, assistant professor of Neurological Surgery and a co-author of the study.
Understanding how the relationship between brain structure and cognitive function changes throughout the life course has remained elusive. However, previous work suggests that fluid intelligence—the ability to problem solve and think and reason abstractly—depends heavily on two regions of the brain: the prefrontal cortex and parietal cortex, both of which are involved in decision-making and sensory perception, among other functions.
Furthermore, investigating the association between brain structure and cognitive function may provide additional information about brain maturation and aging, as well as the physiological causes of cognitive impairment.
In the current study, the investigators developed novel gCNNs, a specialized deep learning model that extracts distinct morphological features such as cortical thickness and subcortical structure from converted brain MRI scans to predict fluid intelligence.
“We are reducing the brain to its surfaces only, meaning that we are able to capture information not only about folding patterns, but also about curvature and relationships between surfaces across tens of thousands of nodes including the outer cortical surface, the inner cortical surface and the surface of seven subcortical brain structures,” Bandt said.
Using their novel gCNNs, the scientists extracted morphologic information of cortical ribbons and subcortical structures from two large MRI datasets involving patients from different age groups.
Using this approach, the investigators were able to demonstrate that their model significantly outperformed other similar state-of-the-art methods and that using a combination of cortical and subcortical structures provided the most accurate predictions.
Additionally, across both datasets, they found that structural features of the amygdala, hippocampus and nucleus accumbens (NAc), along with temporal, parietal and cingulate cortex, drove the fluid intelligence prediction.
“Prior work investigating the neuroanatomic substrate of fluid intelligence has identified associations between widespread cortical areas, but relatively few relationships have been reported with subcortical structures.
“Our study added to these studies by identifying involvement of the bilateral NAc, hippocampus in the prediction of fluid intelligence, which have been linked to the aspects of cognitive science such as reward processing in judgment and decision-making as well as emotion regulation,” said Yunan Wu, Ph.D., a graduate student in the McCormick School of Engineering’s Department of Electrical and Computer Engineering and lead author of the study.
According to the authors, their surface-based gCNNs offer the opportunity to map identified relationships between neurocognition and brain anatomy for myriad research purposes. The method also requires less training time and computations, making it more efficient to apply to other comprehensive datasets.
For example, another recent study led by Bandt used gCNN analysis for aging and dementia, finding that the pace of brain aging differs between healthy individuals and patients with dementia.
“We are now looking to see if similar cognitive measures can be predicted using this method as has been done in our work here on fluid intelligence, but also can we predict the onset of dementia and potentially prevent or delay it before it starts,” Bandt said.
About this deep learning and cognition research news
Author: Melissa Rohman
Source: Northwestern University
Contact: Melissa Rohman – Northwestern University
Image: The image is in the public domain
Original Research: Open access.
“A multicohort geometric deep learning study of age dependent cortical and subcortical morphologic interactions for fluid intelligence prediction” by Yunan Wu et al. Scientific Reports
Abstract
A multicohort geometric deep learning study of age dependent cortical and subcortical morphologic interactions for fluid intelligence prediction
The relationship of human brain structure to cognitive function is complex, and how this relationship differs between childhood and adulthood is poorly understood.
One strong hypothesis suggests the cognitive function of Fluid Intelligence (Gf) is dependent on prefrontal cortex and parietal cortex.
In this work, we developed a novel graph convolutional neural networks (gCNNs) for the analysis of localized anatomic shape and prediction of Gf. Morphologic information of the cortical ribbons and subcortical structures was extracted from T1-weighted MRIs within two independent cohorts, the Adolescent Brain Cognitive Development Study (ABCD; age: 9.93 ± 0.62 years) of children and the Human Connectome Project (HCP; age: 28.81 ± 3.70 years).
Prediction combining cortical and subcortical surfaces together yielded the highest accuracy of Gf for both ABCD (R = 0.314) and HCP datasets (R = 0.454), outperforming the state-of-the-art prediction of Gf from any other brain measures in the literature.
Across both datasets, the morphology of the amygdala, hippocampus, and nucleus accumbens, along with temporal, parietal and cingulate cortex consistently drove the prediction of Gf, suggesting a significant reframing of the relationship between brain morphology and Gf to include systems involved with reward/aversion processing, judgment and decision-making, motivation, and emotion.
