Why, Sometimes, We Don’t See What We Actually Saw

Summary: Crashes in visual processing occur when neurons processing one image are tasked with processing another too quickly. This results in either one or both images being unable to reach our conscious awareness.

Source: Georgetown University Medical Center

Georgetown neuroscientists say they have identified how people can have a “crash in visual processing” — a bottleneck of feedforward and feedback signals that can cause us not to be consciously aware of stimuli that our brain recognized.

In the Journal of Vision, investigators describe what can occur when the brain is asked to process more information than it can handle. The phenomenon, which they dub a “crash in visual processing,” happens when the neurons busy processing one image are tasked with processing another too quickly, and then either one or both images do not reach conscious awareness.

“Prior studies have shown that people are rather poor at detecting objects of interest that appear close together in time, even though the human brain can process up to 70 images per second,” says the study’s senior investigator, neuroscientist Maximilian Riesenhuber, PhD, a professor of neuroscience at Georgetown. “Our study shows a specific limitation of the visual system and explains why our consciousness cannot keep up. When someone tells you they didn’t see something that occurred in a chaotic situation, maybe they did, but they didn’t know that they did.”

The study provides evidence for the theory that a bottleneck can occur in the neuronal pathway that takes in visual stimuli. That pathway starts at the back of the brain and extends forward, rapidly processing the visual signals up to the frontal cortex (“feedforward”), and then sending them back again to the areas the stimuli were first processed in (“feedback”).

“The feedback wave appears to be crucial for participants to actually become conscious of the stimuli their brains had processed in the ‘feedforward’ pass,” Riesenhuber explains.

The study included a series of EEG experiments in which participants viewed images of natural scenes streamed to them in short bursts at a rate of 12 per second, and answered how many images contained animals, and also what the animals were.

The crash in visual processing happens when the back of the brain is stimulated again with a second image before the feedforward and feedback loop needed for the first image is completed, Riesenhuber explains.

This shows blurred lights
The crash in visual processing happens when the back of the brain is stimulated again with a second image before the feedforward and feedback loop needed for the first image is completed, Riesenhuber explains. The image is credited to Georgetown University Medical Center News.

The researchers say their conclusions not only are relevant to how, when and where capacity limits in the brain’s processing abilities can arise, but also have ramifications that span consciousness to learning and attention.

“In addition to introducing a theory that explains the underlying reason for the lack of awareness, our study also shows how to avoid the neuronal signal ‘crash’ and increase awareness,” explains the study’s lead author, Jacob G. Martin, PhD. “When we experimentally reduced the interference between the feedforward and feedback portions of the two stimuli, we observed improved detection and categorization performance.”

“Such findings are exciting because they could lead to novel methods for accelerating cognitive processing and learning in humans,” he adds.

In addition to Riesenhuber and Martin, study investigators include Patrick H. Cox of George Washington University and Clara A. Scholl of Johns Hopkins University, who contributed to this research while both were training at Georgetown.

Funding: This research was supported in part by a National Science Foundation CAREER award (#0449743).

The authors report having no personal financial interests related to the study.

About this neuroscience research article

Source:
Georgetown University Medical Center
Media Contacts:
Karen Teber – Georgetown University Medical Center
Image Source:
The image is credited to Georgetown University Medical Center News.

Original Research: Open access
“A crash in visual processing: Interference between feedforward and feedback of successive targets limits detection and categorization”. Jacob G. Martin; Patrick H. Cox; Clara A. Scholl; Maximilian Riesenhuber.
Nature doi:10.1167/19.12.20.

Abstract

A crash in visual processing: Interference between feedforward and feedback of successive targets limits detection and categorization

The human visual system can detect objects in streams of rapidly presented images at presentation rates of 70 Hz and beyond. Yet, target detection is often impaired when multiple targets are presented in quick temporal succession. Here, we provide evidence for the hypothesis that such impairments can arise from interference between “top-down” feedback signals and the initial “bottom-up” feedforward processing of the second target. Although it is has been recently shown that feedback signals are important for visual detection, this “crash” in neural processing affected both the detection and categorization of both targets. Moreover, experimentally reducing such interference between the feedforward and feedback portions of the two targets substantially improved participants’ performance. The results indicate a key role of top-down re-entrant feedback signals and show how their interference with a successive target’s feedforward process determine human behavior. These results are not just relevant for our understanding of how, when, and where capacity limits in the brain’s processing abilities can arise, but also have ramifications spanning topics from consciousness to learning and attention.

Feel free to share this Visual Neuroscience News.
Join our Newsletter
I agree to have my personal information transferred to AWeber for Neuroscience Newsletter ( more information )
Sign up to receive our recent neuroscience headlines and summaries sent to your email once a day, totally free.
We hate spam and only use your email to contact you about newsletters. You can cancel your subscription any time.