Summary: Two new studies shed light on the processes that underlie the integration and storage of sensory information.
Source: SISSA.
How are raw sensory signals transformed into a brain representation of the world that surrounds us? The question was first posed over 100 years ago, but new experimental strategies make the challenge more exciting than ever. SISSA investigators have now uncovered the contributions to perception of a brain region called posterior parietal cortex.
In two separate papers published in Neuron and Nature, researchers show the posterior parietal cortex contributes to the merging of signals from different sensory modalities, as well the formation of memories about the history of recent stimuli.
For decades, researchers have been investigating how the nervous system make sense of the signals brought into the brain by the sensory organs. Some basic facts are well known: sensory receptor cells convert external events – for instance, light waves, skin vibration, or air pressure waves – into electrical messages that enter the brain. But neuronal activity does not lead to conscious experience until it can be further elaborated in the cerebral cortex.
Ongoing streams of sensory signals are transformed from representations of basic elements, in primary sensory cortical areas, into more complex combinations of features in higher-order areas; sensory events become meaningful once compared to recent and distant memories as well as to expectations. Though the scheme outlined above is backed up by countless studies, the physiological mechanisms remain unresolved.
In a study published in the journal Neuron, researchers at the International School for Advanced Studies (SISSA) investigated how the signals arriving through multiple senses are integrated.
In daily life, once we are familiar with the combined sensory properties of an object, we can recognize that object (for example, a banana) independently of the modality by which we receive the sensory signal – by sight, texture, shape, or taste.
Nader Nikbakht and co-authors looked for the mechanisms by which knowledge about an object is triggered independently of the sensory channel engaged.
The investigators trained rats to explore a grating made of raised black and white bars. The grating’s orientation was reset randomly on each test trial and rats learned to approach the object and respond differently for two categories of orientation: 0±45 degrees (‘horizontal’) and 90±45 degrees (‘vertical’). The rat was allowed to encounter the object through vision, touch, or else vision and touch together.
By comparing accuracy under the three conditions, the investigators found that the performance achieved in the combined visual-tactile condition was better than that predicted by the sum of individual signals: the two sensory channels work together efficiently to generate a better representation of the object.
As the rats explored the object, the investigators also measured neuronal activity in the posterior parietal cortex (PPC), a region positioned between the primary sensory cortical areas for touch, vision and audition. Then they implemented a mathematical model to interpret the information carried by large sets of neurons. The model succeeded in accurately predicting how the rat would classify the stimulus on each single trial.
A final analysis was particularly revealing: while neurons varied widely in how they encoded object orientation or category, a given neuron’s response was identical under the three modality conditions.
“This means that the message of the neurons was the object itself, not the sensory modality through which the object was explored” notes Mathew Diamond, senior investigator in the research.
“Because sensory signals originate with real objects that have multiple physical attributes, it is reasonable to expect that sensory systems have evolved to function in some intermeshed manner,” observes Nikbakht.
“In the mammalian nervous system, dedicated circuits integrate multiple modalities thus, boosting the quality of the percept. Perceiving an object results from fusing the individual senses, not merely summating them.”
Diamond adds that “posterior parietal cortex carries out one step in the transformation done by the cortex as a whole, allowing real things in the world around us to be recognized independently of the sensory system we employ. ‘Supramodal’ perception reflects the construction of a much more abstract representation than that based on simple object features.”
In another study, published in Nature, Athena Akrami and co-authors investigated how recent sensory memories are formed and maintained.
Suppose you have misplaced your cell phone. Its ringtone, repeated once every two seconds, alerts you to an incoming call: it must be somewhere in the house but you are not sure where. As you search for it from room to room, you store in memory the last ring’s amplitude to compare it to the next, in this way determining whether you have moved closer or farther. But how stable is the memory of the last ring?
For many years, neuroscientists have realized that as sensations fade away, their memory shifts towards the ‘prior,’ that is, the statistical mean of many recent stimuli. The neuronal mechanisms generating the prior are unknown.
Akrami and co-investigators trained rats to compare, on each trial, the amplitudes of two auditory stimuli separated by a delay of several seconds, a task that resembles tracking down the cell phone by comparing the current ringtone to the preceding one. Hundreds of such trials (each containing two stimuli) followed each other in a sequence.
The behavioral data revealed that as the rat awaited the second stimulus of the trial, the memory of the first stimulus shifted towards the mean of preceding stimuli. The experiment thus confirmed the sliding of memory towards the expected value, a phenomenon that earlier studies have termed ‘contraction bias.’
But how does the brain apply prior statistics to the stimulus stored in memory?
Because the PPC has been argued to be a critical locus for memory, Akrami’s study focused on this area – the same brain region examined by Nikbakht et al. Indeed, neuronal activity in PPC revealed a trace of the history of stimuli preceding the current trial. Akrami and colleagues then silenced activity in PPC during the task using optogenetics, a method that controls neuronal activity through light. Remarkably, suppressing PPC significantly improved the rats’ performance.
Why?
The key is that memory of the first stimulus was not held in isolation, but instead was influenced by preceding trials. That is, the contraction bias reduced the fidelity of the stored sensory information, pulling the memory towards the prior. In many situations, contraction bias offers an enormous advantage: whenever available information is not exact, the prior is on average the best guess. However, when each sensory event is independent, like in Akrami’s study, contraction bias reduces the accuracy of memories. Removing the influence of PPC by optogenetic silencing allowed the rats to remember each stimulus without the interference carried over from preceding trials.
Neuroscientists now have, for the first time, a good indication of the cortical circuit that holds a record of previous sensory signals.
“In two separate studies, we were able to attribute two very different functions to the same cortical region, the posterior parietal cortex. And, in total, three sensory modalities were found to be integrated within PPC. This attests to the adaptability of cortical processing,” says Diamond. “Primary sensory cortical regions receive signals from the sensory organs and carry a reliable message about the external world. But in all stages of cortical processing beyond this input level, the operations shift from moment to moment according to the behavioral task the whole organism needs to accomplish. Understanding how cortex identifies the current needs and adapts accordingly is an enormous challenge for the future.”
Both studies were collaborative efforts, the first publication originating from collaboration within SISSA between the research groups led by Mathew Diamond and Davide Zoccolan, and the second between SISSA and Princeton University. Nader Nikbakht currently holds a postdoctoral position at the Massachusetts Institute of Technology, where he moved upon completion of his PhD and postdoctoral studies at SISSA. Athena Akrami currently holds a postdoctoral position at Princeton, having completed her PhD and postdoctoral studies at SISSA. A substantial part of the work described in the Nature paper was done at Princeton University in the laboratory of Carlos Brody.
Source: SISSA
Publisher: Organized by NeuroscienceNews.com.
Image Source: NeuroscienceNews.com image is Jeffrey C. Smith lab, SISSA.
Original Research: Open access research in Neuron.
doi:10.1016/j.neuron.2018.01.003
Abstract in Nature.
doi:10.1038/nature25510
[cbtabs][cbtab title=”MLA”]SISSA “How the Brain Constructs the World.” NeuroscienceNews. NeuroscienceNews, 9 February 2018.
<https://neurosciencenews.com/sensory-signaling-8468/>.[/cbtab][cbtab title=”APA”]SISSA (2018, February 9). How the Brain Constructs the World. NeuroscienceNews. Retrieved February 9, 2018 from https://neurosciencenews.com/sensory-signaling-8468/[/cbtab][cbtab title=”Chicago”]SISSA “How the Brain Constructs the World.” https://neurosciencenews.com/sensory-signaling-8468/ (accessed February 9, 2018).[/cbtab][/cbtabs]
Abstract
Supralinear and Supramodal Integration of Visual and Tactile Signals in Rats: Psychophysics and Neuronal Mechanisms
Highlights
•Rats combine vision and touch to distinguish two grating orientation categories
•Performance with vision and touch together reveals synergy between the two channels
•Posterior parietal cortex (PPC) neuronal responses are invariant to modality
•PPC neurons carry information about object orientation and the rat’s categorization
Summary
To better understand how object recognition can be triggered independently of the sensory channel through which information is acquired, we devised a task in which rats judged the orientation of a raised, black and white grating. They learned to recognize two categories of orientation: 0° ± 45° (“horizontal”) and 90° ± 45° (“vertical”). Each trial required a visual (V), a tactile (T), or a visual-tactile (VT) discrimination; VT performance was better than that predicted by optimal linear combination of V and T signals, indicating synergy between sensory channels. We examined posterior parietal cortex (PPC) and uncovered key neuronal correlates of the behavioral findings: PPC carried both graded information about object orientation and categorical information about the rat’s upcoming choice; single neurons exhibited identical responses under the three modality conditions. Finally, a linear classifier of neuronal population firing replicated the behavioral findings. Taken together, these findings suggest that PPC is involved in the supramodal processing of shape.
Abstract
Posterior parietal cortex represents sensory history and mediates its effects on behaviour
Many models of cognition and of neural computations posit the use and estimation of prior stimulus statistics: it has long been known that working memory and perception are strongly impacted by previous sensory experience, even when that sensory history is not relevant to the current task at hand. Nevertheless, the neural mechanisms and regions of the brain that are necessary for computing and using such prior experience are unknown. Here we report that the posterior parietal cortex (PPC) is a critical locus for the representation and use of prior stimulus information. We trained rats in an auditory parametric working memory task, and found that they displayed substantial and readily quantifiable behavioural effects of sensory-stimulus history, similar to those observed in humans and monkeys. Earlier proposals that the PPC supports working memory predict that optogenetic silencing of this region would impair behaviour in our working memory task. Contrary to this prediction, we found that silencing the PPC significantly improved performance. Quantitative analyses of behaviour revealed that this improvement was due to the selective reduction of the effects of prior sensory stimuli. Electrophysiological recordings showed that PPC neurons carried far more information about the sensory stimuli of previous trials than about the stimuli of the current trial. Furthermore, for a given rat, the more information about previous trial sensory history in the neural firing rates of the PPC, the greater the behavioural effect of sensory history, suggesting a tight link between behaviour and PPC representations of stimulus history. Our results indicate that the PPC is a central component in the processing of sensory-stimulus history, and could enable further neurobiological investigation of long-standing questions regarding how perception and working memory are affected by prior sensory information.
