Serotonin Helps Your Brain Predict Future Rewards

Summary: New research reveals that serotonin plays a key role in how the brain predicts future rewards, shedding light on its puzzling activity in response to both pleasure and pain. Scientists found that serotonin neurons encode a โ€œprospective code for value,โ€ signaling expectations about upcoming outcomes and how rapidly those expectations are changing.

This helps the brain assess the value of possible actions in shifting environments, guiding everyday decision-making. The findings challenge long-held assumptions about serotonin and offer a unifying theory relevant to neuroscience, psychology, psychiatry, and AI.

Key Facts:

  • Future Forecasting: Serotonin neurons encode expectations about upcoming rewards and punishments.
  • Broad Activation: These neurons respond to surprise, pain, and pleasureโ€”depending on expected value.
  • Brain vs. Machine: The brain’s value-signaling system via serotonin differs significantly from artificial systems.

Source: University of Ottawa

In our day-to-day lives, weโ€™re constantly making a slew of decisions from immediate matters to prospects on the far horizon.

But the evolutionary nuts-and-bolts of how our brains weigh these numerous daily decisions and what role is played by the neurotransmitter serotonin has been shrouded in mystery.

This shows a brain.
While the overall picture was extremely puzzling, he says it was then they realized they might be chasing something promising. Credit: Neuroscience News

Now, a new study led by an interdisciplinaryย University of Ottawa Faculty of Medicineย team delivers fascinating findings on this big topic and potentially unravels a hidden aspect of what our nervous systemโ€™s extraordinarily complex serotonin system is really doing inside the enigmatic organ in our skulls.

Published in the journalย Nature, this studyย from a highly impactful international collaboration was considered by one of the expert reviewers who evaluated the work to offer โ€œbroad implications across neuroscience, psychology, and psychiatry, enhancing our understanding of serotoninโ€™s role in mood regulation, learning, and motivated behavior.โ€

The teamโ€™s innovative work merges ideas from reinforcement learning (RL) theory โ€“ used in neuroscience to better understand learning, behavior, and decision-making โ€“ with recent hard-won insights into the filtering properties of the brainโ€™s dorsal raphe nucleus. Thatโ€™s a region of the mammalian brainstem rich in serotonin-producing neurons.

Serotonin is often painted as the brainโ€™s โ€œpleasure chemical.โ€ Antidepressant drugs such as selective serotonin reuptake inhibitors (SSRIs) famously target the serotonin system as part of a multi-billion-dollar industry.

However, serotoninโ€™s precise role in the nervous system is ambiguous and perplexing: Itโ€™s implicated in everything from mood and movement regulation to appetite and sleep-wake cycles. The fact that itโ€™s activated by pain, pleasure and surprise has long been a brain research puzzle.

With thisย study, the uOttawa-led researchers put forth a unifying perspective on serotonin they dub a โ€œprospective code for valueโ€ โ€“ a biological code for how the brain places a value for future rewards.

This code essentially explains why serotonin neurons are activated in the brain in response to both rewards and punishments, with a preference for surprising rewards.

โ€œOur work asks the question: What does serotonin tell the brain? In a nutshell, we find that its message closely matches the expectation of future rewards,โ€ saysย senior author Dr. Richard Naud, associate professor at the Faculty of Medicineโ€™sย Department of Cellular and Molecular Medicineand the uOttawaย Department of Physics.

Co-author Dr. Jean-Claude Bรฉรฏque,ย professor in the Department of Cellular and Molecular Medicine, puts the main findings like this: โ€œYour brain needs to compute the expected value of the actions you contemplate and undertake as you interact with a changing world, asking โ€˜Whatโ€™s the value of this decision versus that decision in that particular environment?โ€™

“Thatโ€™s a hard problem. So what we think serotonin actually does in the brain is encode the expected value of a particular environment or course of actions in order to ultimately guide everyday decisions.โ€

Drs. Bรฉรฏque and Naud are both members of theย uOttawa Brain and Mind Research Instituteโ€™s Centre for Neural Dynamics and Artificial Intelligence.

The Initial Spark

The germ of the idea began years ago at the uOttawa Faculty of Medicine whenย first author Emerson Harkin,ย then a PhD student in Dr. Naudโ€™s lab, started to simulate reinforcement-learning models while working on the biophysical properties of serotonin neurons.

Dr. Harkin, who finished his PhD work at uOttawa in late 2023 and was awarded his degree in March 2024, says the core idea came โ€œhalf-serendipitously.โ€

After investing a lot of time and effort studying the electrical properties of the brain cells that produce serotonin, he and his uOttawa Faculty of Medicine supervisors started looking closely at findings from other labs that focused on measuring the activity of serotonin neurons in animals experiencing rewards and punishments.

While the overall picture was extremely puzzling, he says it was then they realized they might be chasing something promising.

โ€œNobody seemed to have considered the possibility that serotonin neurons might be activated byย changesย in the animalโ€™s surroundings, like the start of a signal that reward will arrive soon or the end of a punishment,โ€ says Dr. Harkin, referring to lab experiments with mouse models.

โ€œWhen we looked at these previous results through the lens of what we had seen under our microscopes and with our electrodes, a lot of results that had previously seemed puzzling or contradictory suddenly started to fit together.โ€

Now in Germany doing a postdoc at the Max Planck Institute for Biological Cybernetics, Dr. Harkin asserts that the findings show a big part of what the serotonin system does is send a โ€œmessage to the rest of the brain saying: โ€œHereโ€™s our best guess about how good your near future will be, and hereโ€™s how quickly that guess is improving.โ€

Dr. Naud, a computational neuroscience expert who drilled down on the theoryโ€™s deeply complex math, explains the initial idea evolved quite a bit over the last couple of years as the collaborative team finetuned the work with โ€œlots of reading, lots of discussion, lots of thinking.โ€

Next Steps

Looking forward, the research team aims to study the role of serotonin on behavior to try and figure out what the rest of the brain does with the neurotransmitterโ€™s messages. Dr. Naud says perhaps finding ways of employing reinforcement-learning theory on frameworks can help them do this.

Interestingly, Dr. Naud, whose neuroscience work often has implications for theories of learning and memory that can inform future developments in Artificial Intelligence (AI), believes the teamโ€™s study just published in Nature appears to show how special the nervous system really is.

โ€œIn a way I feel that the teamโ€™s findings show that the brain doesn’t work the way machines do. If we perturb the signaling of rewards in the machine it would do many things that the perturbation in brains don’t do,โ€ he says.

About this neuroscience research news

Author: Paul Logothetis
Source: University of Ottawa
Contact: Paul Logothetis – University of Ottawa
Image: The image is credited to Neuroscience News

Original Research: Closed access.
A prospective code for value in the serotonin system” by Richard Naud et al. Nature


Abstract

A prospective code for value in the serotonin system

The in vivo responses of dorsal raphe nucleus serotonin neurons to emotionally salient stimuli are a puzzle. Existing theories centring on reward, surprise, salienceย and uncertaintyย individually account for some aspects of serotonergic activity but not others.

Merging ideas from reinforcement learning theory with recent insights into the filtering properties of the dorsal raphe nucleus, here we find a unifying perspective in a prospective code for value.

This biological code for near-future reward explains why serotonin neurons are activated by both rewards and punishments, and why these neurons are more strongly activated by surprising rewards but have no such surprise preference for punishmentsโ€”observations that previous theories have failed to reconcile.

Finally, our model quantitatively predicts in vivo population activity better than previous theories.

By reconciling previous theories and establishing a precise connection with reinforcement learning, our work represents an important step towards understanding the role of serotonin in learning and behaviour.

Join our Newsletter
I agree to have my personal information transferred to AWeber for Neuroscience Newsletter ( more information )
Sign up to receive our recent neuroscience headlines and summaries sent to your email once a day, totally free.
We hate spam and only use your email to contact you about newsletters. You can cancel your subscription any time.