How Does the Brain Make Perceptual Predictions Over Time?

Summary: Researchers propose a new framework to help explain how the brain is able to make predictions.

Source: NYU.

NYU neuroscientist David Heeger offers a new framework to explain how the brain makes predictions.

Prediction is crucial for brain function—without forecasting, our actions would always be too late because of the delay in neural processing. However, there has been limited theoretical work explaining how our brains perform perceptual predictions over time.

In the latest issue of Proceedings of the National Academy of Sciences (PNAS), New York University neuroscientist David Heeger offers a new framework to explain how the brain makes predictions. He outlines how “prediction” may be a general principle of cortical function—along with the already-established role of inference.

“It has long been recognized that the brain performs a kind of inference, combining sensory information with expectations,” explains Heeger, a professor in NYU’s Center for Neural Science. “Those expectations can come from the current context, from memory recall, or as an ongoing prediction over time. This new theory puts all of this together and formalizes it mathematically.”

Largely missing from our understanding of brain function had been models akin to those routinely employed by meteorologists. In making their predictions, forecasters rely on past weather information to project climate conditions over the next several days.

“Similarly, the neural networks in our brains embody a type of model of our surroundings,” Heeger observes. “However, we don’t have a clear understanding of how they operate to make predictions.”

Existing theories of brain function and neural networks used in artificial intelligence use a hierarchical structure: sensory input comes in at one end and progressively more abstract representations are computed along the hierarchy.

But this “feedforward”/pipeline processing architecture, Heeger argues, does not account for the brain’s predictive capabilities because, unlike weather models, it does not explain how it loops in earlier information—a dynamic Heeger’s theory includes.

“It’s possible to run this process the other way around—to take an abstract representation at the top of the hierarchy and run it backwards, from top to bottom through the neural net, to generate something like a sensory prediction or expectation,” he explains.

Overall, Heeger’s theory blends inference with prediction. The brain’s neural network can process in a feedforward manner—from sensory input to an abstract representation—akin to typical AI neural networks. Heeger’s theory can instead run in a feedback mode—to generate a sensory prediction from an abstract representation (i.e., a kind of memory recall or mental imagery). Or it can run in a mode that is a combination of the two, in which inferences mix sensory input with prediction.

The theory also posits a role for noise or variability in neural activity to explore different possible interpretations, even when the sensory input and prediction are the same.

“This noise-driven process of exploration may be the neural basis of creativity,” he speculates.

Heeger hypothesizes that neuromodulators like acetylcholineine change the brain state to control which mode—purely feedforward, purely feedback, or a combination—is operating at each moment in time. The amount of noise, which determines the amount of exploration, is controlled by other neuromodulators like noradrenaline and by oscillations in brain activity, he suggests.

Image shows a brain.
In Proceedings of the National Academy of Sciences (PNAS), New York University neuroscientist David Heeger offers a new framework to explain how the brain makes predictions. He outlines how “prediction” may be a general principle of cortical function—along with the already-established role of inference. NeuroscienceNews.com image is for illustrative purposes only.

The theory, which uses the model embedded in the neural network to predict and explore over time, offers promise in both the fields of neuroscience research and AI.

One of these areas is the assessment of the factors that explain autism. There is no special genetic mechanism that causes autism (so-called “autism genes” account for only a small percentage of cases). Rather, individuals with autism have a neurocomputational deficit—the brain’s processing doesn’t function properly. By understanding more fully how the brain effectively computes, Heeger says, we can potentially shed light on exactly what the neurocomputational differences are. Likewise for other developmental disorders and psychiatric illnesses.

In addition, while AI seeks to replicate human decision-making and processing, it cannot fully capture these phenomena if it’s exclusively drawing from a “feedforward” architecture, ignoring prediction and exploration.

“The theory of neural function that I’m outlining aims to fill in some of the significant dynamics that AI is missing,” Heeger says.

About this neuroscience research article

Source: James Devitt – NYU
Image Source: NeuroscienceNews.com image is in the public domain.
Original Research: Abstract for “Theory of cortical function” by David J. Heeger in PNAS. Published online February 6 2017 doi:10.1073/pnas.1619788114

Cite This NeuroscienceNews.com Article

[cbtabs][cbtab title=”MLA”]NYU “How Does the Brain Make Perceptual Predictions Over Time?.” NeuroscienceNews. NeuroscienceNews, 8 February 2017.
<https://neurosciencenews.com/perceptual-predictions-neuroscience-6080/>.[/cbtab][cbtab title=”APA”]NYU (2017, February 8). How Does the Brain Make Perceptual Predictions Over Time?. NeuroscienceNew. Retrieved February 8, 2017 from https://neurosciencenews.com/perceptual-predictions-neuroscience-6080/[/cbtab][cbtab title=”Chicago”]NYU “How Does the Brain Make Perceptual Predictions Over Time?.” https://neurosciencenews.com/perceptual-predictions-neuroscience-6080/ (accessed February 8, 2017).[/cbtab][/cbtabs]


Abstract

Theory of cortical function

Most models of sensory processing in the brain have a feedforward architecture in which each stage comprises simple linear filtering operations and nonlinearities. Models of this form have been used to explain a wide range of neurophysiological and psychophysical data, and many recent successes in artificial intelligence (with deep convolutional neural nets) are based on this architecture. However, neocortex is not a feedforward architecture. This paper proposes a first step toward an alternative computational framework in which neural activity in each brain area depends on a combination of feedforward drive (bottom-up from the previous processing stage), feedback drive (top-down context from the next stage), and prior drive (expectation). The relative contributions of feedforward drive, feedback drive, and prior drive are controlled by a handful of state parameters, which I hypothesize correspond to neuromodulators and oscillatory activity. In some states, neural responses are dominated by the feedforward drive and the theory is identical to a conventional feedforward model, thereby preserving all of the desirable features of those models. In other states, the theory is a generative model that constructs a sensory representation from an abstract representation, like memory recall. In still other states, the theory combines prior expectation with sensory input, explores different possible perceptual interpretations of ambiguous sensory inputs, and predicts forward in time. The theory, therefore, offers an empirically testable framework for understanding how the cortex accomplishes inference, exploration, and prediction.

“Theory of cortical function” by David J. Heeger in PNAS. Published online February 6 2017 doi:10.1073/pnas.1619788114

Feel free to share this Neuroscience News.
Join our Newsletter
I agree to have my personal information transferred to AWeber for Neuroscience Newsletter ( more information )
Sign up to receive our recent neuroscience headlines and summaries sent to your email once a day, totally free.
We hate spam and only use your email to contact you about newsletters. You can cancel your subscription any time.