Summary: New research on the bouba-kiki effect reveals crossmodal mapping occurs independently on conscious awareness.
Source: APS.
Our tendency to match specific sounds with specific shapes, even abstract shapes, is so fundamental that it guides perception before we are consciously aware of it, according to new research in Psychological Science.
The “bouba-kiki” effect, originally reported over 85 years ago and replicated many times since, shows that people consistently pair the soft-sounding nonsense word “bouba” with soft-looking, round shapes and they typically pair the sharp-sounding nonsense word “kiki” with spiky-looking, angular shapes. This effect seems to emerge across cultures and age groups, indicating that it may represent a universal mapping between different modes of perception.
The new findings from three experiments show that the bouba-kiki effect operates on a deeper, more fundamental level than previously observed:
“This is the first report that congruence between a visual word form and the visual properties of a shape can influence behavior when neither the word nor the object has been seen,” says researcher Shao-Min (Sean) Hung of Duke-NUS Medical School in Singapore, first author on the research.
In one experiment, Hung and co-authors Suzy Styles (Nanyang Technological University) and Po-Jang (Brown) Hsieh (Duke-NUS Medical School) used a technique that involves presenting different images to the left and right eyes. To participants’ dominant eye, the researchers presented a series of flashing images; to the nondominant eye, they presented a target image that gradually faded in. Initially, participants were unaware of the target image and could only see the competing, flashing images.
In this experiment, the target image was always a nonsense word, bubu or kiki, inside of a shape. Sometimes the word (bubu) was congruent with the shape it was in (round) and sometimes it was incongruent with the shape (angular). The participants pressed a key whenever the target image became visible.
Timing data showed that the target image broke through to conscious awareness faster when it was congruent than when it was incongruent, indicating that participants perceived and processed the relationship between word and shape before they were consciously aware of the stimuli.
To ensure that participants were mapping the roundness or angularity of the word sounds and not just the shapes of the letters in the written words, the researchers conducted a second study in which they taught participants to “read” two unfamiliar letters that lacked distinctive round or angular components. That is, participants learned to arbitrarily associate the sounds “bubu” and “kiki” to these unfamiliar letters.
Again, the results showed that whichever letter was taught as “kiki” broke through to awareness faster when it was inside the angular shape compared with the rounded shape; and whichever letter stood for “bubu” broke through faster when it was inside the rounded shape compared with the angular shape.
“The findings here show that once we have learned the sound of a letter, we are able to not only extract the sound without consciously perceiving the letter, but also map this unconsciously extracted sound to an unconscious shape,” Hung explains.
Additional findings revealed that the bouba-kiki effect operated outside of awareness even when participants listened to word sounds. In a third study, the researchers used another technique for measuring perception outside awareness, presenting a faint shape very briefly in between two images that masked the shape’s visibility. The researchers varied the intensity of the shape, to determine the level at which it became visible to the participants. Once again, the data showed that congruent sounds facilitated conscious awareness of the shape, lowering the threshold at which the participants reported seeing the shape.
“All these findings expand the limit of unconscious processing, demonstrating that crossmodal mapping occurs outside of the realm of conscious awareness,” says Hung.
Together, these experiments show that the bouba-kiki effect emerges unconsciously before we even have a chance to deliberately consider the relation between sound and shape. That is, “a word can sound like a shape before the shape has been seen,” Hung concludes.
Source: Po-Jang (Brown) Hsieh – APS
Image Source: NeuroscienceNews.com image is adapted from the APS press release.
Original Research: Full open access research for “Can a Word Sound Like a Shape Before You Have Seen It? Sound-Shape Mapping Prior to Conscious Awareness” by Shao-Min Hung, Suzy J. Styles, and Po-Jang Hsieh in Psychological Science. Published online January 23 2017 doi:10.1177/0956797616677313
[cbtabs][cbtab title=”MLA”]APS “Words Can Sound “Round” or “Sharp” Without Us Realizing It.” NeuroscienceNews. NeuroscienceNews, 9 February 2017.
<https://neurosciencenews.com/word-sounds-neuropsychology-6087/>.[/cbtab][cbtab title=”APA”]APS (2017, February 9). Words Can Sound “Round” or “Sharp” Without Us Realizing It. NeuroscienceNew. Retrieved February 9, 2017 from https://neurosciencenews.com/word-sounds-neuropsychology-6087/[/cbtab][cbtab title=”Chicago”]APS “Words Can Sound “Round” or “Sharp” Without Us Realizing It.” https://neurosciencenews.com/word-sounds-neuropsychology-6087/ (accessed February 9, 2017).[/cbtab][/cbtabs]
Abstract
Can a Word Sound Like a Shape Before You Have Seen It? Sound-Shape Mapping Prior to Conscious Awareness
Nonarbitrary mappings between sound and shape (i.e., the bouba-kiki effect) have been shown across different cultures and early in development; however, the level of processing at which this effect arises remains unclear. Here we show that the mapping occurs prior to conscious awareness of the visual stimuli. Under continuous flash suppression, congruent stimuli (e.g., “kiki” inside an angular shape) broke through to conscious awareness faster than incongruent stimuli. This was true even when we trained people to pair unfamiliar letters with auditory word forms, a result showing that the effect was driven by the phonology, not the visual features, of the letters. Furthermore, visibility thresholds of the shapes decreased when they were preceded by a congruent auditory word form in a masking paradigm. Taken together, our results suggest that sound-shape mapping can occur automatically prior to conscious awareness of visual shapes, and that sensory congruence facilitates conscious awareness of a stimulus being present.
“Can a Word Sound Like a Shape Before You Have Seen It? Sound-Shape Mapping Prior to Conscious Awareness” by Shao-Min Hung, Suzy J. Styles, and Po-Jang Hsieh in Psychological Science. Published online January 23 2017 doi:10.1177/0956797616677313
