Summary: A new study reveals how the brain combines words into phrases when reading.
Source: Cornell.
When we learn to read, we say one word at a time. But how does the brain actually put words together when we read full sentences?
An international team of researchers, including a Cornell cognitive scientist, reports physiological evidence showing how the brain combines words into phrases in real time during reading.
“Phrase structure indeed appears as a major determinant of the dynamic profile of brain activity in language areas,” they wrote.
The finding supports a concept that’s been at the heart of psycholinguistics since the 1960s. The research is described in the April 17 issue of the Proceedings of the National Academy of Sciences (PNAS).
“Up until now, we’ve never had such direct evidence for phrase structure as it relates to language understanding,” said co-author John T. Hale, associate professor of linguistics in the College of Arts and Sciences.
The new findings also support the theory that people anticipate what words or phrases might be coming next, given what they’ve just heard, Hale added. However, the work indicates that activity in the brain’s language areas cannot be reduced solely to predictability effects, as some theorists have argued.
The team of French and American researchers recorded the brain’s activity in the language areas of the left hemisphere as a dozen study volunteers read simple sentences. The participants, who all have epilepsy, had electrodes inserted into their brains just prior to surgical treatment for their disorder. This enabled the researchers to see instantaneously the parts of the brain that were activated, when and for how long, as a person processed the sentences.
The patients read sentences three to 10 words long, such as “Bill Gates slept in Paris,” presented one word at a time in their native language, either English or French.
The research team found that the brain fired with each successive word, but, significantly, the brain activity dropped off suddenly whenever words could be merged into a phrase.
As people read words one by one, they must retain those words in short-term memory until they can make sense of the words as a unit, Hale said. “The maintenance of these memories is a reason that we think brain activity might be high at certain times,” he said. Once a complete phrase emerges, “you can merge all of those memories together into one phrase. And you no longer have to remember it. So, the activity drops off.”
The researchers compared the patterns of brain activity with several theoretical models of word-by-word parsing. The best-fitting models included an action that merges multiple words together into a phrase, whenever that would be grammatically possible.
“We related those intracranial signals to linguistically-plausible models of how comprehension might actually work. That’s what had not been done before. These models give us a sense of what those signals might mean,” Hale said.
The research team included Matthew Nelson, Christophe Pallier and Stanislas Dehaene of the NeuroSpin Center in France; Imen El Karoui, Laurent Cohen and Lionel Naccache of the French National Center for Medical Research; Kristof Giber and Sydney Cash of Harvard Medical School; Xiaofang Yang of Stanford University; and Hilda Koopman of University of California, Los Angeles.
Source: Susan Kelley – Cornell
Image Source: NeuroscienceNews.com image is in the public domain.
Original Research: Abstract for “Neurophysiological dynamics of phrase-structure building during sentence processing” by Matthew J. Nelson, Imen El Karoui, Kristof Giber, Xiaofang Yang, Laurent Cohen, Hilda Koopman, Sydney S. Cash, Lionel Naccache, John T. Hale, Christophe Pallier, and Stanislas Dehaene in PNAS. Published online April 17 2017 doi:10.1073/pnas.1701590114
[cbtabs][cbtab title=”MLA”]Cornell “Measuring Effects of Sentence Structure in the Brain.” NeuroscienceNews. NeuroscienceNews, 19 April 2017.
<https://neurosciencenews.com/neuroscience-sentence-structure-6450/>.[/cbtab][cbtab title=”APA”]Cornell (2017, April 19). Measuring Effects of Sentence Structure in the Brain. NeuroscienceNew. Retrieved April 19, 2017 from https://neurosciencenews.com/neuroscience-sentence-structure-6450/[/cbtab][cbtab title=”Chicago”]Cornell “Measuring Effects of Sentence Structure in the Brain.” https://neurosciencenews.com/neuroscience-sentence-structure-6450/ (accessed April 19, 2017).[/cbtab][/cbtabs]
Abstract
Neurophysiological dynamics of phrase-structure building during sentence processing
Although sentences unfold sequentially, one word at a time, most linguistic theories propose that their underlying syntactic structure involves a tree of nested phrases rather than a linear sequence of words. Whether and how the brain builds such structures, however, remains largely unknown. Here, we used human intracranial recordings and visual word-by-word presentation of sentences and word lists to investigate how left-hemispheric brain activity varies during the formation of phrase structures. In a broad set of language-related areas, comprising multiple superior temporal and inferior frontal sites, high-gamma power increased with each successive word in a sentence but decreased suddenly whenever words could be merged into a phrase. Regression analyses showed that each additional word or multiword phrase contributed a similar amount of additional brain activity, providing evidence for a merge operation that applies equally to linguistic objects of arbitrary complexity. More superficial models of language, based solely on sequential transition probability over lexical and syntactic categories, only captured activity in the posterior middle temporal gyrus. Formal model comparison indicated that the model of multiword phrase construction provided a better fit than probability-based models at most sites in superior temporal and inferior frontal cortices. Activity in those regions was consistent with a neural implementation of a bottom-up or left-corner parser of the incoming language stream. Our results provide initial intracranial evidence for the neurophysiological reality of the merge operation postulated by linguists and suggest that the brain compresses syntactically well-formed sequences of words into a hierarchy of nested phrases.
“Neurophysiological dynamics of phrase-structure building during sentence processing” by Matthew J. Nelson, Imen El Karoui, Kristof Giber, Xiaofang Yang, Laurent Cohen, Hilda Koopman, Sydney S. Cash, Lionel Naccache, John T. Hale, Christophe Pallier, and Stanislas Dehaene in PNAS. Published online April 17 2017 doi:10.1073/pnas.1701590114
