AI-Designed Serotonin Sensor May Help Scientists Study Sleep and Mental Health

Summary: Artificial intelligence technology redesigned a bacterial protein that helps researchers track serotonin in the brain in real-time.

Source: NIH

Serotonin is a neurochemical that plays a critical role in the way the brain controls our thoughts and feelings. For example, many antidepressants are designed to alter serotonin signals sent between neurons.

In an article in Cell, National Institutes of Health-funded researchers described how they used advanced genetic engineering techniques to transform a bacterial protein into a new research tool that may help monitor serotonin transmission with greater fidelity than current methods. Preclinical experiments, primarily in mice, showed that the sensor could detect subtle, real-time changes in brain serotonin levels during sleep, fear, and social interactions, as well as test the effectiveness of new psychoactive drugs.

The study was funded, in part, by the NIH’s Brain Research through Advancing Innovative Neurotechnologies (BRAIN) Initiative which aims to revolutionize our understanding of the brain under healthy and disease conditions.

The study was led by researchers in the lab of Lin Tian, Ph.D., principal investigator at the University of California Davis School of Medicine. Current methods can only detect broad changes in serotonin signaling. In this study, the researchers transformed a nutrient-grabbing, Venus flytrap-shaped bacterial protein into a highly sensitive sensor that fluorescently lights up when it captures serotonin.

Previously, scientists in the lab of Loren L. Looger, Ph.D., Howard Hughes Medical Institute Janelia Research Campus, Ashburn, Virginia, used traditional genetic engineering techniques to convert the bacterial protein into a sensor of the neurotransmitter acetylcholine. The protein, called OpuBC, normally snags the nutrient choline, which has a similar shape to acetylcholine.

For this study, the Tian lab worked with Dr. Looger’s team and the lab of Viviana Gradinaru, Ph.D., Caltech, Pasadena, California, to show that they needed the added help of artificial intelligence to completely redesign OpuBC as a serotonin catcher.

The researchers used machine learning algorithms to help a computer ‘think up’ 250,000 new designs. After three rounds of testing, the scientists settled on one. Initial experiments suggested that the new sensor reliably detected serotonin at different levels in the brain while having little or no reaction to other neurotransmitters or similarly shaped drugs.

Experiments in mouse brain slices showed that the sensor responded to serotonin signals sent between neurons at synaptic communications points. Meanwhile, experiments on cells in petri dishes suggested that the sensor could effectively monitor changes in these signals caused by drugs, including cocaine, MDMA (also known as ecstasy) and several commonly used antidepressants.

Finally, experiments in mice showed that the sensor could help scientists study serotonin neurotransmission under more natural conditions. For instance, the researchers witnessed an expected rise in serotonin levels when mice were awake and a fall as mice fell asleep. They also spotted a greater drop when the mice eventually entered the deeper, R.E.M. sleep states.

Traditional serotonin monitoring methods would have missed these changes. In addition, the scientists saw serotonin levels rise differently in two separate brain fear circuits when mice were warned of a foot shock by a ringing bell. In one circuit – the medial prefrontal cortex – the bell triggered serotonin levels to rise fast and high whereas in the other – the basolateral amygdala – the transmitter crept up to slightly lower levels.

In the spirit of the BRAIN Initiative, the researchers plan to make the sensor readily available to other scientists. They hope that it will help researchers gain a better understanding of the critical role serotonin plays in our daily lives and in many psychiatric conditions.

Funding: This study was supported by grants from the NIH (NS090604, NS013522, NS007431, MH107056, MH117069, AA019454, AA011605, AA025475 , GM124165, RR029205); NIH Intramural Research Programs at the National Institute on Alcohol Abuse and Alcoholism (AA000421), the National Institute of Neurological Disorders and Stroke, and the National Institute of Mental Health; the U.S. Department of Energy (Contract No. DE-AC02-06CH11357); the Howard Hughes Medical Institute; the Heritage Medical Research Institute; the Center for Molecular and Cellular Neuroscience of the Chen Institute; the Beckman Institute for CLARITY, Optogenetics and Vector Engineering Research; the Mistletoe Foundation; and the ARCS Foundation.

About this AI research news

Source: NIH
Contact: Christopher Thomas – NIH
Image: The image is credited to Tian lab. University of California Davis School of Medicine.

Original Research: Closed access.
Directed Evolution of a Selective and Sensitive Serotonin Sensor via Machine Learning” by Unger, E. K., Keller, J. P., Altermatt, M., et al. Cell


Directed Evolution of a Selective and Sensitive Serotonin Sensor via Machine Learning


  • Developed a machine learning approach for rapid binding-pocket redesign
  • Engineered a high dynamic range, sensitive, selective sensor for 5-HT: iSeroSnFR
  • Demonstrated the use of iSeroSnFR for fiber photometry in awake behaving mice
  • Developed a clinically relevant assay using iSeroSnFR for 5-HT transporter function


Serotonin plays a central role in cognition and is the target of most pharmaceuticals for psychiatric disorders. Existing drugs have limited efficacy; creation of improved versions will require better understanding of serotonergic circuitry, which has been hampered by our inability to monitor serotonin release and transport with high spatial and temporal resolution. We developed and applied a binding-pocket redesign strategy, guided by machine learning, to create a high-performance, soluble, fluorescent serotonin sensor (iSeroSnFR), enabling optical detection of millisecond-scale serotonin transients. We demonstrate that iSeroSnFR can be used to detect serotonin release in freely behaving mice during fear conditioning, social interaction, and sleep/wake transitions. We also developed a robust assay of serotonin transporter function and modulation by drugs. We expect that both machine-learning-guided binding-pocket redesign and iSeroSnFR will have broad utility for the development of other sensors and in vitro and in vivo serotonin detection, respectively.

Join our Newsletter
I agree to have my personal information transferred to AWeber for Neuroscience Newsletter ( more information )
Sign up to receive our recent neuroscience headlines and summaries sent to your email once a day, totally free.
We hate spam and only use your email to contact you about newsletters. You can cancel your subscription any time.