Summary: Researchers report computer based analysis of speech transcripts from teens at risk of psychosis were able to predict, with 83% accuracy, who would develop symptoms within 2 years.
Source: Mount Sinai Hospital.
Computer-based analyses of speech transcripts obtained from interviews with at-risk youths were able to predict which youths would later develop psy-chosis within two years, with an accuracy of up to 83 percent. In two independent cohorts of young people at risk for psychosis, a disturbance in the flow of meaning when speaking, other-wise known as being tangential or going off track, predicted who would later develop psychosis.
This same computer-based language classifier was able to predict psychosis onset in a second at-risk cohort with 79 percent accuracy, and could discriminate speech from individuals with psy-chosis from healthy individuals with an accuracy of 72 percent.
Taken together, the results from this study suggest that this technology has the potential to im-prove prediction of psychosis and other disorders.
The results of the study will be published online in World Psychiatry on January 22.
Disorganized thinking, a symptom of psychosis, is regularly assessed using interview-based clinical ratings of speech. It is characterized by tangential language, looseness of associations, and reduced complexity of speech. While it can be severe enough to impair effective communi-cation, language disturbance is more typically a subtle but persistent feature that can be present prior to the onset of psychosis in young people at risk.
This study examined transcripts from interviews with at-risk young people in two different co-horts–one in New York City with 34 participants and one in Los Angeles with 59 participants–for whom psychosis onset within the next two years was known. The transcripts were analyzed by computer using automated natural language processing methods to determine differences in speech between those who developed psychosis and those who did not. “The results of this study are exciting because this technology has the potential to improve prediction of psychosis and ultimately help us prevent psychosis by helping researchers develop re-mediation and training strategies that target the cognitive deficits that may underlie language disturbance,” said the study’s first author, Cheryl Corcoran, MD, Associate Professor of Psychiatry, Program Leader in Psychosis Risk, Icahn School of Medicine at Mount Sinai.
“More broadly, language and behavior are the primary sources of data for psychiatrists to diag-nose and treat mental disorders,” said Dr. Corcoran. “There are now novel computerized methods to characterize complex behaviors such as language. Speech is easy to collect and inexpensive to analyze using computer-based analysis. This technology could be applied across psychiatry, and plausibly in other fields of medicine.”
About this neuroscience research article
Other institutions involved in the study include the IBM T.J. Watson Research Center; the Uni-versity of Buenos Aires, Argentina; the University of California, Los Angeles; and the New York State Psychiatric Institute at Columbia University Medical Center.
Funding: This research was supported by grants from the U.S. National Institute of Mental Health (R01 MH 107558; R03 MH 108933, the New York State Office of Mental Health, and a NAR-SAD/BBRF Young Investigator Award and Miller Family Term Chair to C.E. Bearden.
[cbtabs][cbtab title=”MLA”]Mount Sinai Hospital “Speech Analysis Software Predicts Psychosis in Those At Risk With 83% Accuracy.” NeuroscienceNews. NeuroscienceNews, 23 January 2018. <https://neurosciencenews.com/psychosis-speech-analysis-8357/>.[/cbtab][cbtab title=”APA”]Mount Sinai Hospital (2018, January 23). Speech Analysis Software Predicts Psychosis in Those At Risk With 83% Accuracy. NeuroscienceNews. Retrieved January 23, 2018 from https://neurosciencenews.com/psychosis-speech-analysis-8357/[/cbtab][cbtab title=”Chicago”]Mount Sinai Hospital “Speech Analysis Software Predicts Psychosis in Those At Risk With 83% Accuracy.” https://neurosciencenews.com/psychosis-speech-analysis-8357/ (accessed January 23, 2018).[/cbtab][/cbtabs]
Prediction of psychosis across protocols and risk cohorts using automated language analysis
Language and speech are the primary source of data for psychiatrists to diagnose and treat mental disorders. In psychosis, the very structure of language can be disturbed, including semantic coherence (e.g., derailment and tangentiality) and syntactic complexity (e.g., concreteness). Subtle disturbances in language are evident in schizophrenia even prior to first psychosis onset, during prodromal stages. Using computer-based natural language processing analyses, we previously showed that, among English-speaking clinical (e.g., ultra) high-risk youths, baseline reduction in semantic coherence (the flow of meaning in speech) and in syntactic complexity could predict subsequent psychosis onset with high accuracy. Herein, we aimed to cross-validate these automated linguistic analytic methods in a second larger risk cohort, also English-speaking, and to discriminate speech in psychosis from normal speech. We identified an automated machine-learning speech classifier – comprising decreased semantic coherence, greater variance in that coherence, and reduced usage of possessive pronouns – that had an 83% accuracy in predicting psychosis onset (intra-protocol), a cross-validated accuracy of 79% of psychosis onset prediction in the original risk cohort (cross-protocol), and a 72% accuracy in discriminating the speech of recent-onset psychosis patients from that of healthy individuals. The classifier was highly correlated with previously identified manual linguistic predictors. Our findings support the utility and validity of automated natural language processing methods to characterize disturbances in semantics and syntax across stages of psychotic disorder. The next steps will be to apply these methods in larger risk cohorts to further test reproducibility, also in languages other than English, and identify sources of variability. This technology has the potential to improve prediction of psychosis outcome among at-risk youths and identify linguistic targets for remediation and preventive intervention. More broadly, automated linguistic analysis can be a powerful tool for diagnosis and treatment across neuropsychiatry.