Summary: People who suffer from synethesia are also more sensitive to the association between the sound of words and visual shapes, researchers report.
Source: Emory University.
Neuroscientists at Emory University have found that people who experience a mixing of the senses, known as synesthesia, are more sensitive to associations everyone has between the sounds of words and visual shapes. The results are published in the European Journal of Neuroscience.
Synesthesia is a stable trait, and estimated to be present in 1 to 4 percent of people. It can be inherited, although the precise genes have not been identified. One of the most common forms of synesthesia is when people involuntarily see particular colors in connection with letters, numbers or sounds.
Many artists and composers have described their experiences with synesthesia. Children with synesthesia say sometimes that it is distracting when they are trying to read. Thus, understanding the origins of synesthesia may help people with dyslexia or other learning differences, or people who have lost their sight or hearing and are trying to engage in sensory substitution for rehabilitation.
Researchers led by neurologist Krish Sathian recruited 17 people with synesthesia, and asked them to take a form of the IAT (implicit association test). Known for its use probing social attitudes such as racial prejudice, the IAT can also assess “cross-modal correspondences.”
An example of a cross-modal correspondence is that we describe musical notes as being “high” or “low” – words that also signify relative positions in space. Another is that we think of some sounds such as “m” and “l” as soft, and are more likely to associate them with rounded shapes. Similarly, we connect hard sounds such as “k” and “t” with angular shapes.
“There’s been a debate about synesthesia,” Sathian says. “Are the associations synesthetes have just extreme versions of cross-modal correspondences that other people have, or are they qualitatively different?”
Sathian and his colleagues found that people with synesthesia were more sensitive to correspondences between the sounds of pseudowords — words without meaning in English — and rounded or angular shapes.
“It shows that something about their synesthesia is spilling over into another domain,” he says. “But that spillover is limited to a correspondence that is post-perceptual and symbolic – it’s not purely sensory.”
Such correspondences are called “sound-symbolic,” and may be relevant to the evolutionary origins of language, Sathian adds.
People with synesthesia were not significantly more sensitive to purely sensory associations between the pitch of a sound and the size or position of a shape, compared to non-synesthetes. In this situation, sensitivity on the IAT means that study participants would have a greater difference in response times to congruent pairings of shape and sound (a high position in space, and a high pitch, for example) in comparison to incongruent pairings.
Participants in the study were recruited through advertisements on the Emory campus and screened with an online test called the Synesthesia Battery. This test confirms whether people who report they have synesthesia have consistent associations.
A connection between letters or other symbols and colors, also known as “grapheme-color” synesthesia, was the most common type in the Emory study. It may represent the presence of idiosyncratic wrinkles in how people learned their letters or other symbols during childhood. Indeed, Sathian notes that one study suggests that a popular brand of refrigerator magnets had an influence on what letter-color associations people with this form of synesthesia developed.
To be sure, people with synesthesia are not all the same, says senior research associate Simon Lacey, the first author of the paper. Some describe experiencing connections between shapes and tastes, or porous boundaries between self and non-self (so-called “mirror touch”).”
Brain imaging studies have shown that people with synesthesia tend to be wired differently: they display hyperconnectivity between parts of their brains related to their synesthetic experiences. Scientists have proposed that synesthesia represents alterations in pruning, the process of editing connections between brain cells.
Sathian is professor of neurology, rehabilitation medicine and psychology at Emory University and executive director of the Rehabilitation R&D Center for Visual and Neurocognitive Rehabilitation at the Atlanta Veterans Affairs Medical Center. Sathian and collaborator Lynne Nygaard, professor of psychology, are exploring the neural bases of cross-modal correspondences and of synesthesia using brain imaging studies.
Source: Quinn Eastman – Emory University
Image Source: This NeuroscienceNews.com image is adapted from the Emory press release.
Original Research: Abstract for “Synesthesia strengthens sound-symbolic cross-modal correspondences” by Simon Lacey, Margaret Martinez, Kelly McCormick, and K. Sathian in European Journal of Neuroscience. Published online September 15 2016 doi:10.1111/ejn.13381
Synesthesia strengthens sound-symbolic cross-modal correspondences
Synesthesia is a phenomenon in which an experience in one domain is accompanied by an involuntary secondary experience in another, unrelated domain; in classical synesthesia, these associations are arbitrary and idiosyncratic. Cross-modal correspondences refer to universal associations between seemingly unrelated sensory features, e.g., auditory pitch and visual size. Some argue that these phenomena form a continuum, with classical synesthesia being an exaggeration of universal cross-modal correspondences, whereas others contend that the two are quite different, since cross-modal correspondences are non-arbitrary, non-idiosyncratic, and do not involve secondary experiences. Here, we used the implicit association test to compare synesthetes’ and non-synesthetes’ sensitivity to cross-modal correspondences. We tested the associations between auditory pitch and visual elevation, auditory pitch and visual size, and sound-symbolic correspondences between auditory pseudowords and visual shapes. Synesthetes were more sensitive than non-synesthetes to cross-modal correspondences involving sound-symbolic, but not low-level sensory, associations. We conclude that synesthesia heightens universally experienced cross-modal correspondences, but only when these involve sound symbolism. This is only partly consistent with the idea of a continuum between synesthesia and cross-modal correspondences, but accords with the idea that synesthesia is a high-level, post-perceptual phenomenon, with spillover of the abilities of synesthetes into domains outside their synesthesias. To our knowledge, this is the first demonstration that synesthetes, relative to non-synesthetes, experience stronger cross-modal correspondences outside their synesthetic domains.
“Synesthesia strengthens sound-symbolic cross-modal correspondences” by Simon Lacey, Margaret Martinez, Kelly McCormick, and K. Sathian in European Journal of Neuroscience. Published online September 15 2016 doi:10.1111/ejn.13381