Mental stress assessment based on feature level fusion of fNIRS and EEG signals

• Main Authors: Al-Shargie, F., Tang, T.B., Badruddin, N., Dass, S.C., Kiguchi, M.
• Format: Article
• Published: Institute of Electrical and Electronics Engineers Inc. 2017
• Online Access: https://www.scopus.com/inward/record.uri?eid=2-s2.0-85011982455&doi=10.1109%2fICIAS.2016.7824060&partnerID=40&md5=df408c0a5a61773b085d43e4c4ae25e7; http://eprints.utp.edu.my/20226/

This study aims to improve the detection rate of mental stress using the complementary nature of functional Near Infrared Spectroscopy (fNIRS) and Electroencephalogram (EEG). Simultaneous measurements of fNIRS and EEG signals were conducted on 12 subjects while solving arithmetic problems under two different conditions (control and stress). The stressors in this work were time pressure and negative feedback of individual performance. The study demonstrated significant reduction in the concentration of oxygenated haemoglobin (p=0.0032) and alpha rhythm power (p=0.0213) on the prefrontal cortex (PFC) under stress condition. Specifically, the right PFC and dorsolateral PFC were highly sensitive to mental stress. Using support vector machine (SVM), the mean detection rate of mental stress was 91, 95 and 98 using fNIRS, EEG and fusion of fNIRS and EEG signals, respectively. © 2016 IEEE.