AI Unlocks Secrets of Human Imagination and Memory Formation

Summary: A new study employs generative AI to shed light on how the human brain processes memories for learning, imagination, and planning. The study used a computational model resembling the hippocampus and neocortex’s neural networks to simulate memory encoding and retrieval.

This model demonstrated how the neocortex forms efficient conceptual representations from experiences, allowing for both the recreation of past events and the generation of new ones. The research highlights the brain’s ability to reconstruct memories with unique details, offering insights into memory’s role in survival and prediction.

Key Facts:

  1. The AI model simulates the interaction between the hippocampus and neocortex in memory processing.
  2. The neocortex forms “conceptual” representations, enabling the brain to recreate past experiences and imagine new scenarios.
  3. The study provides insights into memory’s role in survival, predicting future events, and understanding memory distortions.

Source: UCL

Recent advances in generative AI help to explain how memories enable us to learn about the world, re-live old experiences and construct totally new experiences for imagination and planning, according to a new study by UCL researchers.

The study, published in Nature Human Behaviour and funded by Wellcome, uses an AI computational model – known as a generative neural network – to simulate how neural networks in the brain learn from and remember a series of events (each one represented by a simple scene).

The model featured networks representing the hippocampus and neocortex, to investigate how they interact. Both parts of the brain are known to work together during memory, imagination and planning.

This shows a woman.
Humans need to make predictions to survive (e.g. to avoid danger or to find food), and the AI networks suggest how, when we replay memories while resting, it helps our brains pick up on patterns from past experiences that can be used to make these predictions. Credit: Neuroscience News

Lead author, PhD student Eleanor Spens (UCL Institute of Cognitive Neuroscience), said: “Recent advances in the generative networks used in AI show how information can be extracted from experience so that we can both recollect a specific experience and also flexibly imagine what new experiences might be like.

“We think of remembering as imagining the past based on concepts, combining some stored details with our expectations about what might have happened.”

Humans need to make predictions to survive (e.g. to avoid danger or to find food), and the AI networks suggest how, when we replay memories while resting, it helps our brains pick up on patterns from past experiences that can be used to make these predictions.

Researchers played 10,000 images of simple scenes to the model. The hippocampal network rapidly encoded each scene as it was experienced. It then replayed the scenes over and over again to train the generative neural network in the neocortex.

The neocortical network learned to pass the activity of the thousands of input neurons (neurons that receive visual information) representing each scene through smaller intermediate layers of neurons (the smallest containing only 20 neurons), to recreate the scenes as patterns of activity in its thousands of output neurons (neurons that predict the visual information).

This caused the neocortical network to learn highly efficient “conceptual” representations of the scenes that capture their meaning (e.g. the arrangements of walls and objects) – allowing both the recreation of old scenes and the generation of completely new ones.

Consequently, the hippocampus was able to encode the meaning of new scenes presented to it, rather than having to encode every single detail, enabling it to focus resources on encoding unique features that the neocortex couldn’t reproduce – such as new types of objects.

The model explains how the neocortex slowly acquires conceptual knowledge and how, together with the hippocampus, this allows us to “re-experience” events by reconstructing them in our minds.

The model also explains how new events can be generated during imagination and planning for the future, and why existing memories often contain “gist-like” distortions – in which unique features are generalised and remembered as more like the features in previous events.  

Senior author, Professor Neil Burgess (UCL Institute of Cognitive Neuroscience and UCL Queen Square Institute of Neurology), explained: “The way that memories are re-constructed, rather than being veridical records of the past, shows us how the meaning or gist of an experience is recombined with unique details, and how this can result in biases in how we remember things.”

About this AI, imagination, and memory research news

Author: Poppy Danby
Source: UCL
Contact: Poppy Danby – UCL
Image: The image is credited to Neuroscience News

Original Research: The findings will appear in Nature Human Behavior

Join our Newsletter
I agree to have my personal information transferred to AWeber for Neuroscience Newsletter ( more information )
Sign up to receive our recent neuroscience headlines and summaries sent to your email once a day, totally free.
We hate spam and only use your email to contact you about newsletters. You can cancel your subscription any time.
  1. Does your research provide further insights into how those with aphantasia (no conscious mental imagery), access or recombine concepts for imagination and simulation/prediction differently than those with mental imagery. People with aphantasia can be very creative and use imagination, just absent mental imagery. https://aphantasia.com/

  2. Look at who is sponsoring the research…glaxowellcomesmith… follow the money to see how reliable the outcomes are…

    1. Very good thinking. That’s pretty much how everything is done these days. On the flip side of ur comment though who else could actually afford to have these kinda studies done but these rich fat cow pharmas. It’s all about perspective. Take what you feel is useful and junk the rest that’s their opinions. Idk that’s what I do. But I do enjoy you reminding ppl about who sponsored. Thank u for that info definitely!!

Comments are closed.