How the Brain Processes Sign Language

Summary: The Broca’s area, an area of the brain associated with spoken language processing, plays a crucial role in the ability to process sign language.

Source: Max Planck Institute

The ability to speak is one of the essential characteristics that distinguishes humans from other animals. Many people would probably intuitively equate speech and language. However, cognitive science research on sign languages since the 1960s paints a different picture: Today it is clear, sign languages are fully autonomous languages and have a complex organization on several linguistic levels such as grammar and meaning.

Previous studies on the processing of sign language in the human brain had already found some similarities and also differences between sign languages and spoken languages. Until now, however, it has been difficult to derive a consistent picture of how both forms of language are processed in the brain.

Researchers at the MPI CBS now wanted to know which brain regions are actually involved in the processing of sign language across different studies – and how large the overlap is with brain regions that hearing people use for spoken language processing. In a meta-study recently published in the journal Human Brain Mapping, they pooled data from sign language processing experiments conducted around the world.

“A meta-study gives us the opportunity to get an overall picture of the neural basis of sign language. So, for the first time, we were able to statistically and robustly identify the brain regions that were involved in sign language processing across all studies,” explains Emiliano Zaccarella, last author of the paper and group leader in the Department of Neuropsychology at the MPI CBS.

The researchers found that especially the so-called Broca’s area in the frontal brain of the left hemisphere is one of the regions that was involved in the processing of sign language in almost every study evaluated. This brain region has long been known to play a central role in spoken language, where it is used for grammar and meaning. In order to better classify their results from the current meta-study, the scientists compared their findings with a database containing several thousand studies with brain scans.

This shows hands
The researchers found that especially the so-called Broca’s area in the frontal brain of the left hemisphere is one of the regions that was involved in the processing of sign language in almost every study evaluated. Image is in the public domain

The Leipzig-based researchers were indeed able to confirm that there is an overlap between spoken and signed language in Broca’s area. They also succeeded in showing the role played by the right frontal brain – the counterpart to Broca’s area on the left side of the brain. This also appeared repeatedly in many of the sign language studies evaluated, because it processes non-linguistic aspects such as spatial or social information of its counterpart.

This means that movements of the hands, face and body – of which signs consist – are in principle perceived similarly by deaf and hearing people. Only in the case of deaf people, however, do they additionally activate the language network in the left hemisphere of the brain, including Broca’s area. They therefore perceive the gestures as gestures with linguistic content – instead of as pure movement sequences, as would be the case with hearing people.

The results demonstrate that Broca’s area in the left hemisphere is a central node in the language network of the human brain. Depending on whether people use language in the form of signs, sounds or writing, it works together with other networks. Broca’s area thus processes not only spoken and written language, as has been known up to now, but also abstract linguistic information in any form of language in general.

“The brain is therefore specialized in language per se, not in speaking,” explains Patrick C. Trettenbrein, first author of the publication and doctoral student at the MPI CBS. In a follow-up study, the research team now aims to find out whether the different parts of Broca’s area are also specialized in either the meaning or the grammar of sign language in deaf people, similar to hearing people.

About this language processing research news

Source: Max Planck Institute
Contact: Verena Müller – Max Planck Institute
Image: The image is in the public domain

Original Research: Open access.
Functional neuroanatomy of language without speech: An ALE meta‐analysis of sign language” by Patrick C. Trettenbrein, Giorgio Papitto, Angela D. Friederici, Emiliano Zaccarella. Human Brain Mapping


Functional neuroanatomy of language without speech: An ALE meta‐analysis of sign language

Sign language (SL) conveys linguistic information using gestures instead of sounds. Here, we apply a meta‐analytic estimation approach to neuroimaging studies (N = 23; subjects = 316) and ask whether SL comprehension in deaf signers relies on the same primarily left‐hemispheric cortical network implicated in spoken and written language (SWL) comprehension in hearing speakers.

We show that: (a) SL recruits bilateral fronto‐temporo‐occipital regions with strong left‐lateralization in the posterior inferior frontal gyrus known as Broca’s area, mirroring functional asymmetries observed for SWL. (b)

Within this SL network, Broca’s area constitutes a hub which attributes abstract linguistic information to gestures. (c) SL‐specific voxels in Broca’s area are also crucially involved in SWL, as confirmed by meta‐analytic connectivity modeling using an independent large‐scale neuroimaging database. This strongly suggests that the human brain evolved a lateralized language network with a supramodal hub in Broca’s area which computes linguistic information independent of speech.

Join our Newsletter
I agree to have my personal information transferred to AWeber for Neuroscience Newsletter ( more information )
Sign up to receive our recent neuroscience headlines and summaries sent to your email once a day, totally free.
We hate spam and only use your email to contact you about newsletters. You can cancel your subscription any time.