Summary: Visual neurons selectively respond to color and shape along a continuum. While some neurons are only activated by either a specific color or shape, others are responsive to color and shape simultaneously. The findings contradict previous beliefs about how visual processing works.
Source: Salk Institute
There are hundreds of thousands of distinct colors and shapes that a person can distinguish visually, but how does the brain process all of this information? Scientists previously believed that the visual system initially encodes shape and color with different sets of neurons and then combines them much later. But a new study from Salk researchers, published in Science on June 27, 2019, shows that there are neurons that respond selectively to particular combinations of color and shape.
“New genetic sensors and imaging technologies have allowed us to more thoroughly test the link between visual circuits that process color and shape,” says Edward Callaway, senior author and professor in Salk’s Systems Neurobiology Laboratory. “These findings provide valuable insight about how visual circuits are connected and organized in the brain.”
Similar to a digital camera sensor, light-sensitive cells in the eye (photoreceptors) detect wavelengths of light within specific ranges and at particular locations. This information then travels through the optic nerve to neurons in the visual cortex that interpret the information and begin to decipher the contents of the picture. Scientists long thought that color and shape were extracted separately and then combined only at the highest brain centers, but the new Salk research shows that they are combined much earlier.
“The goal of our study was to better understand how the visual system processes colors and shapes of visual stimuli,” says co-first author Anupam Garg, who is a University of California San Diego MD/PhD student in the Callaway lab. “We wanted to apply new imaging techniques to answer these longstanding questions about visual processing.”
The researchers used imaging technology combined with genetically expressed sensors to study the function of thousands of individual neurons involved in processing color and shape in the primary visual cortex. During long recording periods, roughly 500 possible combinations of color and shape were tested to find the stimulus that best activated each visually-responsive neuron.
The team found that visual neurons selectively responded to color and shape along a continuum–while some neurons were only activated by either a specific color or shape, many other neurons were responsive to a particular color and shape simultaneously, contrary to long-held notions about how visual processing works.
“Our brain encodes visual information efficiently using circuits that are smartly designed. Contrary to what is taught in the classroom–that color and form are processed separately in the early visual cortex and then integrated later by unknown mechanisms–the brain encodes color and form together in a systematic way,” says Peichao Li, co-first author and postdoctoral fellow in the Callaway lab.
“For the last 20 years, I have wanted to know how the visual system processes color, so this finding is truly exciting for me,” says Callaway, who holds the Vincent J. Coates Chair in Molecular Neurobiology. “This discovery lays a foundation for understanding how neural circuits make the computations that lead to color vision. We look forward to building on these findings to determine how the neurons in the visual cortex work together to extract colors and shapes.”
Funding: The work was funded by National Institutes of Health grants (EY022577, NS105129 and EY028084), the Gatsby Charitable Trust and the Pioneer Fund.
Other authors included Mohammad S. Rashid of Salk.
Color and orientation are jointly coded and spatially organized in primate primary visual cortex
Previous studies support the textbook model that shape and color are extracted by distinct neurons in primate primary visual cortex (V1). However, rigorous testing of this model requires sampling a larger stimulus space than previously possible. We used stable GCaMP6f expression and two-photon calcium imaging to probe a very large spatial and chromatic visual stimulus space and map functional microarchitecture of thousands of neurons with single-cell resolution. Notable proportions of V1 neurons strongly preferred equiluminant color over achromatic stimuli and were also orientation selective, indicating that orientation and color in V1 are mutually processed by overlapping circuits. Single neurons could precisely and unambiguously code for both color and orientation. Further analyses revealed systematic spatial relationships between color tuning, orientation selectivity, and cytochrome oxidase histology.