Summary: An auditory-based machine learning algorithm was able to identify children diagnosed with depression and anxiety with 80% accuracy after analyzing recordings of their speech. The algorithm identified eight audio features that signify a higher risk of depression. Of these, a lower pitch of voice, repeatable speech inflections and a higher pitch response to surprise stimuli, were more indicative of depression. Researchers hope to develop a smartphone app that records and analyzes speech immediately, helping to better detect children at risk of internalizing disorders.
Source: University of Vermont
A machine learning algorithm can detect signs of anxiety and depression in the speech patterns of young children, potentially providing a fast and easy way of diagnosing conditions that are difficult to spot and often overlooked in young people, according to new research published in the Journal of Biomedical and Health Informatics.
Around one in five children suffer from anxiety and depression, collectively known as “internalizing disorders.” But because children under the age of eight can’t reliably articulate their emotional suffering, adults need to be able to infer their mental state and recognise potential mental health problems. Waiting lists for appointments with psychologists, insurance issues, and failure to recognise the symptoms by parents all contribute to children missing out on vital treatment.
“We need quick, objective tests to catch kids when they are suffering,” says Ellen McGinnis, a clinical psychologist at the University of Vermont Medical Center’s Vermont Center for Children, Youth and Families and lead author of the study. “The majority of kids under eight are undiagnosed.”
Early diagnosis is critical because children respond well to treatment while their brains are still developing, but if they are left untreated they are at greater risk of substance abuse and suicide later in life. Standard diagnosis involves a 60-90 minute semi-structured interview with a trained clinician and their primary caregiver. McGinnis, along with University of Vermont biomedical engineer and study senior author Ryan McGinnis, has been looking for ways to use artificial intelligence and machine learning to make diagnosis faster and more reliable.
The researchers used an adapted version of a mood induction task called the Trier-Social Stress Task, which is intended to cause feelings of stress and anxiety in the subject. A group of 71 children between the ages of three and eight were asked to improvise a three-minute story and told that they would be judged based on how interesting it was. The researcher acting as the judge remained stern throughout the speech and gave only neutral or negative feedback. After 90 seconds, and again with 30 seconds left, a buzzer would sound and the judge would tell them how much time was left.
“The task is designed to be stressful, and to put them in the mindset that someone was judging them,” says Ellen McGinnis.
The children were also diagnosed using a structured clinical interview and parent questionnaire, both well-established ways of identifying internalizing disorders in children.
The researchers used a machine learning algorithm to analyze statistical features of the audio recordings of each kid’s story and relate them to the child’s diagnosis. They found the algorithm was highly successful at diagnosing children, and that the middle phase of the recordings, between the two buzzers, was the most predictive of a diagnosis.
“The algorithm was able to identify children with a diagnosis of an internalizing disorder with 80% accuracy, and in most cases that compared really well to the accuracy of the parent checklist,” says Ryan McGinnis. It can also give the results much more quickly – the algorithm requires just a few seconds of processing time once the task is complete to provide a diagnosis.
The algorithm identified eight different audio features of the children’s speech, but three in particular stood out as highly indicative of internalizing disorders: low-pitched voices, with repeatable speech inflections and content, and a higher-pitched response to the surprising buzzer. Ellen McGinnis says these features fit well with what you might expect from someone suffering from depression. “A low-pitched voice and repeatable speech elements mirrors what we think about when we think about depression: speaking in a monotone voice, repeating what you’re saying,” says Ellen McGinnis.
The higher-pitched response to the buzzer is also similar to the response the researchers found in their previous work, where children with internalizing disorders were found to exhibit a larger turning-away response from a fearful stimulus in a fear induction task.
The voice analysis has a similar accuracy in diagnosis to the motion analysis in that earlier work, but Ryan McGinnis thinks it would be much easier to use in a clinical setting. The fear task requires a darkened room, toy snake, motion sensors attached to the child and a guide, while the voice task only needs a judge, a way to record speech and a buzzer to interrupt. “This would be more feasible to deploy,” he says.
Ellen McGinnis says the next step will be to develop the speech analysis algorithm into a universal screening tool for clinical use, perhaps via a smartphone app that could record and analyze results immediately. The voice analysis could also be combined with the motion analysis into a battery of technology-assisted diagnostic tools, to help identify children at risk of anxiety and depression before even their parents suspect that anything is wrong.
Other study co-authors include Steven P. Anderau and Reed D. Gurchiek at the University of Vermont and Reed D. Gurchiek, Nestor L. Lopez-Duran, Kate Fitzgerald and Maria Muzik at the University of Michigan.
Source:
University of Vermont
Media Contacts:
Jeff Wakefield – University of Vermont
Image Source:
The image is credited to Anthony Kelly.
Original Research: Closed access
“Giving Voice to Vulnerable Children: Machine Learning Analysis of Speech Detects Anxiety and Depression in Early Childhood”. Ellen W. McGinnis ; Steven P. Anderau ; Jessica Hruschak ; Reed D. Gurchiek ; Nestor L. Lopez-Duran ; Kate Fitzgerald ; Katherine L. Rosenblum ; Maria Muzik ; Ryan McGinnis.
Journal of Biomedical Health and Informatics. doi:10.1109/JBHI.2019.29135904
Abstract
Giving Voice to Vulnerable Children: Machine Learning Analysis of Speech Detects Anxiety and Depression in Early Childhood
Childhood anxiety and depression often go undiagnosed. If left untreated these conditions, collectively known as internalizing disorders, are associated with long-term negative outcomes including substance abuse and increased risk for suicide. This paper presents a new approach for identifying young children with internalizing disorders using a 3-minute speech task. We show that machine learning analysis of audio data from the task can be used to identify children with an internalizing disorder with 80% accuracy (54% sensitivity, 93% specificity). The speech features most discriminative of internalizing disorder are analyzed in detail, showing that affected children exhibit especially low-pitch voices, with repeatable speech inflections and content, and high-pitched response to surprising stimuli relative to controls. This new tool is shown to outperform clinical thresholds on parent-reported child symptoms, which identify children with an internalizing disorder with lower accuracy (67-77 vs. 80%), and similar specificity (85-100 vs. 93%), and sensitivity (0-58 vs. 54%) in this sample. These results point toward the future use of this approach for screening children for internalizing disorders so that interventions can be deployed when they have the highest chance for long-term success.
