Summary: A newly developed robotic thumb imprints how the hand is represented in the brain. Using the robotic thumb, researchers reported improvements in conducting dexterity tasks, such as building with blocks. Additionally, those who trained to use the additional thumb began to feel as though the digit was a part of their body.
Using a robotic ‘Third Thumb’ can impact how the hand is represented in the brain, finds a new study led by UCL researchers.
The team trained people to use a robotic extra thumb and found they could effectively carry out dextrous tasks, like building a tower of blocks, with one hand (now with two thumbs). The researchers report in the journal Science Robotics that participants trained to use the thumb also increasingly felt like it was a part of their body.
Designer Dani Clode began developing the device, called the Third Thumb, as part of an award-winning graduate project at the Royal College of Art, seeking to reframe the way we view prosthetics, from replacing a lost function, to an extension of the human body. She was later invited to join Professor Tamar Makin’s team of neuroscientists at UCL who were investigating how the brain can adapt to body augmentation.
Professor Makin (UCL Institute of Cognitive Neuroscience), lead author of the study, said: “Body augmentation is a growing field aimed at extending our physical abilities, yet we lack a clear understanding of how our brains can adapt to it. By studying people using Dani’s cleverly-designed Third Thumb, we sought to answer key questions around whether the human brain can support an extra body part, and how the technology might impact our brain.”
The Third Thumb is 3D-printed, making it easy to customise, and is worn on the side of the hand opposite the user’s actual thumb, near the little (pinky) finger. The wearer controls it with pressure sensors attached to their feet, on the underside of the big toes. Wirelessly connected to the Thumb, both toe sensors control different movements of the Thumb by immediately responding to subtle changes of pressure from the wearer.
For the study, 20 participants were trained to use the Thumb over five days, during which they were also encouraged to take the Thumb home each day after training to use it in daily life scenarios, totalling two to six hours of wear time per day. Those participants were compared to an additional group of 10 control participants who wore a static version of the Thumb while completing the same training.
During daily sessions in the lab, participants were trained to use the Thumb focusing on tasks that helped increase the cooperation between their hand and the Thumb, such as picking up multiple balls or wine glasses with one hand. They learned the basics of using the Thumb very quickly, while the training enabled them to successfully improve their motor control, dexterity and hand-Thumb coordination. Participants were even able to use the Thumb when distracted – building a wooden block tower while doing a maths problem – or while blindfolded.
Designer Dani Clode (UCL Institute of Cognitive Neuroscience and Dani Clode Design), who was part of the core research team, said: “Our study shows that people can quickly learn to control an augmentation device and use it for their benefit, without overthinking. We saw that while using the Third Thumb, people changed their natural hand movements, and they also reported that the robotic thumb felt like part of their own body.”
First author of the study, Paulina Kieliba (UCL Institute of Cognitive Neuroscience) said: “Body augmentation could one day be valuable to society in numerous ways, such as enabling a surgeon to get by without an assistant, or a factory worker to work more efficiently. This line of work could revolutionise the concept of prosthetics, and it could help someone who permanently or temporarily can only use one hand, to do everything with that hand. But to get there, we need to continue researching the complicated, interdisciplinary questions of how these devices interact with our brains.”
Before and after the training, the researchers scanned participants’ brains using fMRI, while the participants were moving their fingers individually (they were not wearing the Thumb while in the scanner).
The researchers found subtle but significant changes to how the hand that had been augmented with the Third Thumb (but not the other hand) was represented in the brain’s sensorimotor cortex. In our brains, each finger is represented distinctly from the others; among the study participants, the brain activity pattern corresponding to each individual finger became more similar (less distinct).
A week later, some of the participants were scanned again, and the changes in their brain’s hand area had subsided, suggesting the changes might not be long-term, although more research is needed to confirm this.
Paulina Kieliba said: “Our study is the first one investigating the use of an augmentation device outside of a lab. It is the first augmentation study carried over multiple days of prolonged training, and the first to have an untrained comparison group. The success of our study shows the value of neuroscientists working closely together with designers and engineers, to ensure that augmentation devices make the most of our brains’ ability to learn and adapt, while also ensuring that augmentation devices can be used safely.”
Professor Makin added: “Evolution hasn’t prepared us to use an extra body part, and we have found that to extend our abilities in new and unexpected ways, the brain will need to adapt the representation of the biological body.”
Funding: The researchers, based at UCL and the University of Oxford, were supported by the European Research Council, Wellcome and the Sir Halley Stewart Charitable Trust.
About this robotics research news
Contact: Chris Lane – UCL
Image: The image is credited to Dani Clode
Original Research: Closed access.
“Robotic hand augmentation drives changes in neural body representation” by Dani Clode et al. Science Robotics
Robotic hand augmentation drives changes in neural body representation
Humans have long been fascinated by the opportunities afforded through augmentation. This vision not only depends on technological innovations but also critically relies on our brain’s ability to learn, adapt, and interface with augmentation devices.
Here, we investigated whether successful motor augmentation with an extra robotic thumb can be achieved and what its implications are on the neural representation and function of the biological hand. Able-bodied participants were trained to use an extra robotic thumb (called the Third Thumb) over 5 days, including both lab-based and unstructured daily use.
We challenged participants to complete normally bimanual tasks using only the augmented hand and examined their ability to develop hand-robot interactions. Participants were tested on a variety of behavioral and brain imaging tests, designed to interrogate the augmented hand’s representation before and after the training.
Training improved Third Thumb motor control, dexterity, and hand-robot coordination, even when cognitive load was increased or when vision was occluded. It also resulted in increased sense of embodiment over the Third Thumb. Consequently, augmentation influenced key aspects of hand representation and motor control. Third Thumb usage weakened natural kinematic synergies of the biological hand.
Furthermore, brain decoding revealed a mild collapse of the augmented hand’s motor representation after training, even while the Third Thumb was not worn.
Together, our findings demonstrate that motor augmentation can be readily achieved, with potential for flexible use, reduced cognitive reliance, and increased sense of embodiment. Yet, augmentation may incur changes to the biological hand representation.
Such neurocognitive consequences are crucial for successful implementation of future augmentation technologies.