Summary: Study shows pilots in real flight conditions made more errors and had higher anterior prefrontal cortex activation than those who were placed in a simulator, when completing cognitively demanding tasks.
Source: Drexel University.
After a plane engine blew apart at 32,000 feet in the air last month, the pilot flying Southwest Flight 1380 safely brought the Boeing 737 to an emergency landing in Philadelphia. Captain Tammie Jo Shults was heralded a hero, but a different flier may not have been able to respond as adeptly.
Consider what was racing through her mind: where to land, the speed and altitude to maintain, how to aid an injured passenger and comfort a bewildered crew. It’s likely Shults was experiencing “cognitive overload,” said Frédéric Dehais, PhD, a professor at ISAE-SUPAERO in Toulouse, France, and an expert in flight safety.
The efficiency and safety of human-machine systems depend on the cognitive workload and situational awareness of human operators, according to Hasan Ayaz, PhD, an associate research professor in the School of Biomedical Engineering, Science and Health Systems at Drexel University.
“Unfortunately, many human-machine interfaces expose users to workload extremes, diminishing the operator’s attention and potentially leading to catastrophic consequences,” Ayaz said.
An ideal human-machine system would actually be able to read its operator’s mind in real-time, to know how well he or she was paying attention or able to process new information. Such a system may sound like the makings of a sci-fi movie. But Ayaz and Dehais, along with a team of researchers at Drexel and ISAE-SUPAERO, have now successfully measured the brain activity of pilots in real-time using functional near-infrared spectroscopy, or fNIRS. Their results were published this week in Frontiers in Human Neuroscience.
Unlike traditional functional magnetic resonance imaging (fMRI), in which a person is resigned to a large machine while lying down, Drexel’s portable fNIRS system is worn like a headband, making it ideal for measuring brain activity while study subjects move around freely in their natural environments.
The fNIRS system measures “the brain at work” by monitoring blood oxygenation changes in the prefrontal cortex – the area underneath the forehead that is involved in cognitive functions such as problem solving, memory, judgement and impulse control. When first learning a new task, for instance, this area of the brain is highly activated. However, as you become more proficient, these tasks move to other brain areas, clearing up important resources in the prefrontal cortex for skills like split-second decision making.
“The exciting thing is we can now quantify this,” Ayaz said. In a flying scenario, Ayaz envisions that the airplane itself might one day be able to assess the cognitive and emotional state of the pilot, and then make adjustments accordingly.
To find out whether this could be possible, the researchers split 28 pilots into two categories: The first group flew a real aircraft, while the second group operated a flight simulator. In both cases, the researchers monitored the pilots’ brain activity as they completed a series of memorization tasks from pre-recorded air traffic control instructions, which varied in levels of difficulty.
The results showed that the pilots in the real flight condition committed more errors and had higher anterior prefrontal cortex activation than pilots in the simulator when completing cognitively demanding tasks.
The implications are twofold, says Ayaz. First, the researchers successfully demonstrated the feasibility of monitoring cognitive workload in a realistic flight situation. Secondly, the differences between the two groups underscores the need for “ecologically valid” research studies. In other words, solely measuring brain activity in a laboratory likely won’t lead to the most accurate results.
In the future, understanding the underlying neurocognitive process of pilot-plane interactions could help to make simulators more realistic, as well as to improve the safety and efficiency of aircraft-pilot interactions.
“We believe that this type of approach will open a whole new direction of research for studying parameters in an aviation setting and eventually designing better machines,” Dehais said.
Funding: Support for the study by AXA Research Fund.
Source: Lauren Ingeno – Drexel University
Publisher: Organized by NeuroscienceNews.com.
Image Source: NeuroscienceNews.com image is credited to ISAE-SUPAERO.
Original Research: Open access research for “In silico vs. Over the Clouds: On-the-Fly Mental State Estimation of Aircraft Pilots, Using a Functional Near Infrared Spectroscopy Based Passive-BCI” by Thibault Gateau, Hasan Ayaz and Frédéric Dehais in Frontiers in Human Neuroscience. Published May 17 2018.
doi:10.3389/fnhum.2018.00187
[cbtabs][cbtab title=”MLA”]Drexel University “Reading the Minds of Pilots.” NeuroscienceNews. NeuroscienceNews, 21 May 2018.
<https://neurosciencenews.com/pilot-neuroscience-9103/>.[/cbtab][cbtab title=”APA”]Drexel University (2018, May 21). Reading the Minds of Pilots. NeuroscienceNews. Retrieved May 21, 2018 from https://neurosciencenews.com/pilot-neuroscience-9103/[/cbtab][cbtab title=”Chicago”]Drexel University “Reading the Minds of Pilots.” https://neurosciencenews.com/pilot-neuroscience-9103/ (accessed May 21, 2018).[/cbtab][/cbtabs]
Abstract
In silico vs. Over the Clouds: On-the-Fly Mental State Estimation of Aircraft Pilots, Using a Functional Near Infrared Spectroscopy Based Passive-BCI
There is growing interest for implementing tools to monitor cognitive performance in naturalistic work and everyday life settings. The emerging field of research, known as neuroergonomics, promotes the use of wearable and portable brain monitoring sensors such as functional near infrared spectroscopy (fNIRS) to investigate cortical activity in a variety of human tasks out of the laboratory. The objective of this study was to implement an on-line passive fNIRS-based brain computer interface to discriminate two levels of working memory load during highly ecological aircraft piloting tasks. Twenty eight recruited pilots were equally split into two groups (flight simulator vs. real aircraft). In both cases, identical approaches and experimental stimuli were used (serial memorization task, consisting in repeating series of pre-recorded air traffic control instructions, easy vs. hard). The results show pilots in the real flight condition committed more errors and had higher anterior prefrontal cortex activation than pilots in the simulator, when completing cognitively demanding tasks. Nevertheless, evaluation of single trial working memory load classification showed high accuracy (>76%) across both experimental conditions. The contributions here are two-fold. First, we demonstrate the feasibility of passively monitoring cognitive load in a realistic and complex situation (live piloting of an aircraft). In addition, the differences in performance and brain activity between the two experimental conditions underscore the need for ecologically-valid investigations.
