A dataset for emotion recognition using virtual reality and EEG (DER-VREEG): Emotional state classification using low-cost wearable VR-EEG headsets

• Main Authors: Nazmi Sofian Suhaimi, James Mountstephens, Teo, Jason Tze Wi
• Format: Article
• Language: English; English
• Published: MDPI 2022
• Subjects: BF511-593 Affection. Feeling. Emotion; QA71-90 Instruments and machines
• Online Access: https://eprints.ums.edu.my/id/eprint/33492/1/A%20dataset%20for%20emotion%20recognition%20using%20virtual%20reality%20and%20EEG%20%28DER-VREEG%29%2C%20Emotional%20state%20classification%20using%20low-cost%20wearable%20VR-EEG%20headsets.ABSTRACT.pdf; https://eprints.ums.edu.my/id/eprint/33492/2/A%20Dataset%20for%20Emotion%20Recognition%20Using%20Virtual%20Reality%20and%20EEG%20%28DER-VREEG%29%2C%20Emotional%20State%20Classification%20Using%20Low-Cost%20Wearable%20VR-EEG%20Headsets.pdf; https://eprints.ums.edu.my/id/eprint/33492/; https://www.mdpi.com/2504-2289/6/1/16; https://doi.org/10.3390/bdcc6010016

Emotions are viewed as an important aspect of human interactions and conversations, and allow effective and logical decision making. Emotion recognition uses low-cost wearable electroencephalography (EEG) headsets to collect brainwave signals and interpret these signals to provide information on the mental state of a person, with the implementation of a virtual reality environment in different applications; the gap between human and computer interaction, as well as the understanding process, would shorten, providing an immediate response to an individual’s mental health. This study aims to use a virtual reality (VR) headset to induce four classes of emotions (happy, scared, calm, and bored), to collect brainwave samples using a low-cost wearable EEG headset, and to run popular classifiers to compare the most feasible ones that can be used for this particular setup. Firstly, we attempt to build an immersive VR database that is accessible to the public and that can potentially assist with emotion recognition studies using virtual reality stimuli. Secondly, we use a low-cost wearable EEG headset that is both compact and small, and can be attached to the scalp without any hindrance, allowing freedom of movement for participants to view their surroundings inside the immersive VR stimulus. Finally, we evaluate the emotion recognition system by using popular machine learning algorithms and compare them for both intra-subject and inter-subject classification. The results obtained here show that the prediction model for the four-class emotion classification performed well, including the more challenging inter-subject classification, with the support vector machine (SVM Class Weight kernel) obtaining 85.01% classification accuracy. This shows that using less electrode channels but with proper parameter tuning and selection features affects the performance of the classifications.