Summary:
A psychoacoustic investigation led by researchers at Keio University’s Neurosciences and Music Laboratory reveals the objective acoustic properties behind subjective vocal competition judging. Simulating a live classical singing competition in a concert hall, the researchers evaluated 22 classical vocalists performing the aria “Caro mio ben” before five expert judges while measuring core acoustic metrics.
Published in the Journal of Voice, the findings show that overall scores correlate strongly with perceived vibrato, resonance, expressiveness, and acoustic energy in the 2–4 kHz “singer’s formant” range, rather than raw loudness or intonation accuracy. The study also uncovered sex-specific judging criteria: faster vibrato penalized male vocalists, whereas wider vibrato elevated scores for female singers.
Key Facts:
- Singer’s Formant Over Raw Volume: Higher overall competition scores directly correlated with spectral prominence in the 2–4 kHz frequency band (the acoustic “singer’s formant”), while overall vocal loudness showed no significant relationship with judge ratings.
- Core Evaluative Attributes: Expert judges weighted perceived vibrato quality, vocal resonance, and musical expressiveness most heavily; conversely, intonation accuracy, timbre descriptions, and diction clarity had no measurable association with final scores.
- Sex-Divergent Vibrato Standards: Acoustic analyses revealed contrasting sex-specific preferences: male vocalists received lower scores if their vibrato rate was faster, whereas female vocalists achieved higher scores when their vibrato extent (pitch variation width) was wider.
Source: Keio University / Journal of Voice
In classical opera and vocal competitions, expert adjudicators often render definitive judgments within seconds of a performer’s opening phrase. Yet, the pedagogical and aesthetic criteria underpinning these scores have remained steeped in metaphorical, subjective terminology, instructors and adjudicators routinely urge vocalists to produce a sound that is “warmer,” “more focused,” or “ringing.”
Because classical singers perform unamplified in massive concert halls, projecting over full symphonic orchestras requires an extraordinary coordination of respiratory mechanics, laryngeal posture, and vocal tract resonance. However, the lack of standardized, objective acoustic benchmarks creates ambiguity for developing vocalists seeking to understand competitive judging outcomes.
To demystify these artistic evaluations, a research team led by operatic soprano and vocal science researcher Assistant Professor Haruka Kondo, alongside Dr. Sotaro Kondoh and Associate Professor Shinya Fujii at Keio University’s Research Center for Music Science and Neurosciences and Music Laboratory in Japan, simulated a live vocal competition to identify the exact acoustic markers that drive expert appraisal.
Publishing in the Journal of Voice, the investigators mapped how physical acoustic parameters correspond to human perceptual judgments in a professional hall acoustic environment.
Recreating the Concert Hall Audition
To replicate natural performance acoustics, the team recruited 22 classically trained vocalists (10 men and 12 women). Each singer performed the Italian art song “Caro mio ben” a cappella, standing on stage in a live concert hall without microphone amplification or instrumental accompaniment.
A panel of five professional vocal judges scored each performance on a 100-point holistic scale while independently grading six discrete vocal attributes on a 7-point scale: vibrato quality, resonance, timbre, diction clarity, intonation (pitch accuracy), and musical expressiveness.
Concurrently, the researchers extracted four primary acoustic features from the audio recordings:
- Singing Power Ratio (SPR): The ratio of spectral energy between lower frequencies and the 2–4 kHz band, capturing the acoustic “singer’s formant.”
- Loudness Units Relative to Full Scale (LUFS): A standardized psychophysical metric tracking perceived physiological loudness.
- Vibrato Rate: The frequency of pitch modulation cycles per second (speed of oscillation).
- Vibrato Extent: The depth or width of pitch fluctuation above and below the central pitch center.
The Dominance of Resonance and Expressive Nuance
Statistical modeling revealed that overall competition scores were not dictated by sheer vocal power. Raw loudness (LUFS) showed no significant correlation with judges’ rankings. Furthermore, diction clarity, intonation accuracy, and descriptive timbre ratings failed to predict higher placement.
Instead, judges’ overall marks were determined by perceived vibrato quality, vocal resonance, and artistic expressiveness.
Acoustically, this preference was confirmed by the singing power ratio: vocalists who concentrated acoustic energy in the 2–4 kHz frequency band consistently earned the highest marks across both male and female cohorts. This acoustic peak corresponds to the classical “singer’s formant,” an anatomical acoustic clustering achieved by lowering the larynx and widening the pharynx. The formant enables a human voice to produce acoustic energy that cuts through the dense accompaniment of an orchestra without vocal strain.
“Our study bridges the gap between artistic intuition and science and does not aim to replace the expert ear. It helps translate what experienced listeners hear into a shared, measurable language,” explains lead author Haruka Kondo.
Sex-Specific Vibrato Expectations
When evaluating vibrato mechanics, the researchers uncovered an unexpected sex divergence in how acoustic parameters influenced judge preference:
- Male Vocalists: A faster vibrato rate (higher oscillation speed) was strongly associated with lower competition scores. Judges favored slower, steadier pitch modulation in male registers.
- Female Vocalists: Vibrato rate had minimal influence, but vibrato extent (pitch oscillation depth) proved critical: female singers with a wider vibrato extent received significantly higher overall scores.
These findings suggest that expert listeners possess distinct, internalized physiological archetypes for male versus female classical singing, penalizing male voices for perceived tremolo (fluttering) while rewarding female voices that achieve broad, resonant pitch oscillation.
Transforming Vocal Pedagogy and Algorithmic Scoring
By isolating the physical acoustic correlates of vocal excellence, the study offers concrete diagnostic tools for classical vocal training.
“Our results show that something as personal and artistic as ‘a beautiful voice’ can be partly understood through science,” says Kondo. “This could help students understand what their instructors mean when they say, ‘let it ring more’ or ‘your vibrato is too shallow.’ Students could then use these measurements to see how their voices change as they practice between lessons, which could help organizers design clearer scoring sheets and help singers understand their results.”
Beyond the rehearsal studio, the authors emphasize that integrating these acoustic metrics into automated vocal analysis tools and mobile training applications could provide emerging singers with objective, real-time feedback that reflects the trained perception of professional adjudicators.
Questions and Answers
What acoustic feature most strongly predicts high scores in classical singing competitions?
Prominence in the 2–4 kHz frequency range, known as the “singer’s formant,” is the strongest acoustic predictor of high scores. This acoustic resonance allows an unamplified voice to project clearly without relying on raw, fatiguing vocal loudness.
Did vocal loudness or pitch accuracy guarantee higher competition marks?
No. Standardized vocal loudness (LUFS) had no measurable association with higher scores. Similarly, diction clarity and pitch accuracy (intonation) showed no clear statistical link to winning marks, as baseline technical accuracy is presumed at expert levels, leaving resonance, vibrato, and expressiveness as the differentiating factors.
How do vibrato standards differ between male and female opera singers?
Adjudicators evaluate male and female vibrato along distinct acoustic axes. In male singers, a faster vibrato rate was penalized with lower marks, whereas in female singers, a wider vibrato extent (greater depth of pitch modulation) was rewarded with higher overall scores.
Funding information
This work was supported by the Taikichiro Mori Memorial Research Fund of Keio University, the Keio University Doctorate Student Grant-in-Aid Program from the Ushioda Memorial Fund, and JST SPRING [grant number JPMJSP2123]; by the Ishii-Ishibashi Fund (Keio University Grant for Early Career Researchers), JST COI-NEXT [grant number JPMJPF2203], JST PRESTO [grant number JPMJPR23S9], and JSPS KAKENHI [grant numbers 24H02199, 23K25750 and 25K21813]; and by JSPS KAKENHI [grant number 24KJ1930].
Editorial Notes:
- This article was edited by a Neuroscience News editor.
- Journal paper reviewed in full.
- Additional context added by our staff.
About this auditory neuroscience Research:
- Media Contact: Tetyana Khatayeva
- Source: Keio University
- Image Credit: Image credited to Neuroscience News
- Original Research is Open Access: Journal of Voice (Oct 1, 2026). “Vocal Evaluation of Classical Singing in a Concert Hall: Perceptual and Acoustic Associations with Overall Scores in Male and Female Singers.” Authors: Haruka Kondo, Sotaro Kondoh, and Shinya Fujii.
- DOI: 10.1016/j.jvoice.2026.09.070
Abstract
Vocal Evaluation of Classical Singing in a Concert Hall: Perceptual and Acoustic Associations with Overall Scores in Male and Female Singers
Objectives
In classical vocal competitions, judges reduce a performance to a single overall score, yet what that score reflects is unclear. Research has separately identified the perceptual attributes experts use and the acoustic features of trained singing. Few studies link these to expert evaluation, and those that do have used playback of sound-treated recordings and rarely tested for sex differences. Yet classical singing is judged live in halls, and male and female voices differ acoustically. We asked which attributes and acoustic features are associated with the overall score in a concert hall, and whether they differ by sex.
Methods
Twenty-two classical singers (10 males, 12 females) performed Caro mio ben a cappella in a concert hall. Five singer-instructors rated each performance on a 100-point overall score and 7-point scales for six vocal attributes. Singing power ratio (SPR), loudness units full scale (LUFS), vibrato rate (VR), and vibrato extent (VE) were computed from annotated vowel segments of close-microphone recordings. Linear mixed-effects models related the overall score to the ratings or acoustic features, with sex interactions and a random judge intercept.
Results
Higher ratings of vibrato, resonance, and expressiveness were associated with higher overall scores, whereas timbre, diction, and intonation were not. Higher SPR, greater VE, and lower VR were associated with higher overall scores, whereas LUFS was not. Sex interacted with VE and VR but not with SPR or LUFS: the VE association was stronger in females, the VR association in males.
Conclusion
Overall scores were associated with perceived vibrato, resonance, and expressiveness, and with spectral prominence at 2–4 kHz. Vibrato associations were sex-dependent: a faster rate accompanied lower scores in males, a greater extent higher scores in females. These findings provide measurable correlates of expert evaluation under realistic conditions and suggest that vibrato may need to be interpreted with reference to singer sex.
