Education, Science, Technology, Innovation and Life
Open Access
Sign In

Sensitive Trans Formation and Multi-Level Spatiotemporal Awareness Based Eeg Emotion Recognition Model

Download as PDF

DOI: 10.23977/acss.2022.060404 | Downloads: 20 | Views: 732

Author(s)

Wenting Xu 1, Shuhua Liu 2, Xiangru Hou 1, Xin Yin 3

Affiliation(s)

1 Information Engineering Department, Heilongjiang International University, Harbin, China
2 School of Information Science and Technology, Northeast Normal University, Changchun, China
3 School of Computer Science, Beijing Institute of Technology, Beijing, China

Corresponding Author

Xin Yin

ABSTRACT

Electroencephalography (EEG) emotion recognition has important research value in the fields of medical and criminal investigation, so in recent years, deep learning methods have been widely used in the field of EEG emotion recognition. Generally, the spatial and temporal features of EEG signals can reflect the spatial information of EEG in different brain regions and the long-term features of time-related continuous EEG signals. However, the problem of obtaining accurate spatial and temporal features of sequence signals has been neglected in previous studies. In addition, the spatial information transformation of electrode points on brain regions is not accurate enough. To address these issues, we propose a sensitive transformation and multi-level spatiotemporal awareness based EEG emotion recognition model. Through this method, accurate spatial information and more comprehensive EEG spatiotemporal features can be obtained. The evaluation results of SEED dataset show that the proposed approach improves on the state-of-the-art in EEG emotion recognition. The accuracy rates of subject-dependent and subject-independent emotion recognition are 98.49% and 97.95%, which exceeds the best previous accuracy by 1.18%.

KEYWORDS

Emotion Recognition, EEG, Sensitive Transformation, Spatiotemporal Awareness

CITE THIS PAPER

Wenting Xu, Shuhua Liu, Xiangru Hou, Xin Yin, Sensitive Trans Formation and Multi-Level Spatiotemporal Awareness Based Eeg Emotion Recognition Model. Advances in Computer, Signals and Systems (2022) Vol. 6: 31-41. DOI: http://dx.doi.org/10.23977/acss.2022.060404.

REFERENCES

[1] Y. Ahn, S. J. Lee, and J. W. Shin, "Cross-Corpus Speech Emotion Recognition Based on Few-Shot Learning and Domain Adaptation," IEEE Signal Processing Letters, vol. 28, pp. 1190–1194, 2021, doi: 10.1109/LSP.2021.3086395.
[2] D. Y. Liliana, "Emotion recognition from facial expression using deep convolutional neural network," in Journal of Physics: Conference Series, Apr. 2019, vol. 1193, no. 1. doi: 10.1088/1742-6596/1193/1/012004.
[3] F. Ahmed, A. S. M. H. Bari, and M. L. Gavrilova, "Emotion Recognition from Body Movement," IEEE Access, vol. 8, pp. 11761–11781, 2020, doi: 10.1109/ACCESS.2019.2963113.
[4] F. A. Acheampong, H. Nunoo-Mensah, and W. Chen, "Transformer models for text-based emotion detection: a review of BERT-based approaches," Artificial Intelligence Review, 2021, doi: 10.1007/s10462-021-09958-2.
[5] Matlovic, T., et al. "Emotions detection using facial expressions recognition and EEG." International Workshop on Semantic & Social Media Adaptation & Personalization IEEE, 2016.
[6] Jasper H.H, "The Ten Twenty Electrode System: International Federation of Societies for Electroencephalography and Clinical Neurophysiology," American Journal of EEG Technology, vol. 1, no. 1, pp. 13–19, Mar. 1961, doi: 10.1080/00029238.1961.11080571.
[7] Li J, Zhang Z, He H. Hierarchical Convolutional Neural Networks for EEG-Based Emotion Recognition [J]. Cognitive Computation, 2017.
[8] Shen F, Dai G, Lin G, et al. EEG-based emotion recognition using 4D convolutional recurrent neural network [J]. Cognitive Neurodynamics, 2020:1-14.
[9] H Jiang, Jiao R, Wang Z, et al. Construction and Analysis of Emotion Computing Model Based on LSTM [J]. Complexity 2021, 2021.
[10] Hwang S., Hong K., Son G. & Byun H. Learning DE features for EEG-based emotion recognition. Pattern Anal Appl 23, 1323-1335, (2020)
[11] Atkinson J, Campos D. Improving BCI-based emotion recognition by combining EEG feature selection and kernel classifiers [J]. Expert Systems with Applications,2016,10(47) : 35-41 
[12] Zhang, J., Zhou, Y. T. & Liu, Y. EEG-based emotion recognition using an improved radial basis function neural network. J Amb Intel Hum Comp, doi:10.1007/s12652-020-02049-0 (2020)
[13] J. Chen, H. Li, L. Ma, H. Bo, F. Soong, and Y. Shi, "Dual-Threshold-Based Microstate Analysis on Characterizing Temporal Dynamics of Affective Process and Emotion Recognition From EEG Signals," Frontiers in Neuroscience, vol. 15, Jul. 2021, doi: 10.3389/fnins.2021.689791.
[14] J. Li, Z. Zhang, and H. He, "Implementation of EEG emotion recognition system based on hierarchical convolutional neural networks," Lecture Notes in Computer Science, 2016, vol. 10023 LNAI, pp. 22–33. doi: 10.1007/978-3-319-49685-6_3.
[15] Acharya UR, Oh SL, Hagiwara Y, etal. Deep convolutional neural network for the automated detection and diagnosis of seizure using EEG signals [J].Computers in biology and medicine,2018,100:270-278.
[16] Dan Wang and Y. Shang, "Modeling Physiological Data with Deep Belief Networks.," International journal of information and education technology (IJIET), vol. 3, no. 5, pp. 505–511, 2013, doi: 10.7763/IJIET.2013.V3.326.
[17] Salama ES, El-Khoribi RA, Shoman ME, et al. EEG based emotion recognition using 3D convolutional neural networks [J]. International Journal of Advanced Computer Science and Applications, 2018, 9:329.
[18] Acharya, D, et al. "A Long Short Term Memory Deep Learning Network for the Classification of Negative Emotions Using EEG Signals." 2020 International Joint Conference on Neural Networks (IJCNN) 2020.
[19] Li J, Zhang Z, He H. Hierarchical Convolutional Neural Networks for EEG-Based Emotion Recognition [J]. Cognitive Computation, 2017.
[20] Xu H, Plataniotis KN. Affective states classify-cation using EEG and semi-supervised deep learning approaches [C]. IEEE, International Workshop on Multimedia Signal Processing, 2017:1-6.
[21] Zheng W L, Zhu J Y, Lu B L. Identifying stable patterns over time for emotion recognition from EEG[J/OL]. IEEE Transactions on Affective Computing,2018:3-15
[22] Chao H and Y Liu, "Efficiently maintaining the fast updated sequential pattern trees with sequence deletion," IEEE Access, vol. 2, pp. 1374–1383, 2014, doi: 10.1109/ACCESS.2014.2373433.
[23] T. Song, W. Zheng, P. Song, and Z. Cui, "EEG Emotion Recognition Using Dynamical Graph Convolutional Neural Networks," IEEE Transactions on Affective Computing, vol. 11, no. 3, pp. 532–541, Jul. 2020, doi: 10.1109/TAFFC.2018.2817622.
[24] Y. Zhang et al., "An Investigation of Deep Learning Models for EEG-Based Emotion Recognition," Frontiers in Neuroscience, vol. 14, Dec. 2020, doi: 10.3389/fnins.2020.622759.
[25] S. Sheykhivand, Z. Mousavi, T. Y. Rezaii, and A. Farzamnia, "Recognizing Emotions Evoked by Music Using CNN-LSTM Networks on EEG Signals," IEEE Access, vol. 8, pp. 139332–139345, 2020, doi: 10.1109/ACCESS.2020.3011882.
[26] J. Li, Z. Zhang, and H. He, "Hierarchical Convolutional Neural Networks for EEG-Based Emotion Recognition," Cognitive Computation, vol. 10, no. 2, pp. 368–380, Apr. 2018, doi: 10.1007/s12559-017-9533-x.
[27] F. Shen, G. Dai, G. Lin, J. Zhang, W. Kong, and H. Zeng, "EEG-based emotion recognition using 4D convolutional recurrent neural network," Cognitive Neurodynamics, vol. 14, no. 6, pp. 815–828, Dec. 2020, doi: 10.1007/s11571-020-09634-1.
[28] Chung J, Gulcehre C, Cho K, et al. Empirical evaluation of gate recurrent neural networks on sequence modelling [J]. arXiv: Neural and Evolutionary Computing, 2014.
[29] Chaudhari S, Polatkan G, and Ramanath R, "An Attentive Survey of Attention Models," in Proceedings - 2020 35th IEEE/ACM International Conference on Automated Software Engineering, ASE 2020, Sep. 2020, pp. 883–894. doi: 10.1145/1122445.1122456.
[30] [dataset] Wei-Long Zheng, and Bao-Liang Lu, Investigating Critical Frequency Bands and Channels for EEG-based Emotion Recognition with Deep Neural Networks, accepted by IEEE Transactions on Autonomous Mental Development (IEEE TAMD) 7(3): 162-175, 2015.
[31] F. Shen, Y. Peng, W. Kong, and G. Dai, "Multi-scale frequency bands ensemble learning for eeg-based emotion recognition," Sensors (Switzerland), vol. 21, no. 4, pp. 1–20, Feb. 2021, doi: 10.3390/s21041262.
[32] Zhang, L. Su, Y. Zhang, Y. Fu, L. Wu, and S. Liang, "EEG data augmentation for emotion recognition with a multiple generator conditional Wasserstein GAN," Complex & Intelligent Systems, Apr. 2021, doi: 10.1007/s40747-021-00336-7.
[33] Liu S, Wang X, Zhao L, et al. "Subject-independent Emotion Recognition of EEG Signals Based on Dynamic Empirical Convolutional Neural Network" [J]. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 2020, PP(99):1-1.
[34] A. Subasi, T. Tuncer, S. Dogan, D. Tanko, and U. Sakoglu, "EEG-based emotion recognition using tunable Q wavelet transform and rotation forest ensemble classifier," Biomedical Signal Processing and Control, vol. 68, Jul. 2021, doi: 10.1016/j.bspc.2021.102648.
[35] P. Sarma and S. Barma, "Emotion recognition by distinguishing appropriate EEG segments based on random matrix theory," Biomedical Signal Processing and Control, vol. 70, Sep. 2021, doi: 10.1016/j.bspc.2021.102991.
[36] J. Liu et al., "EEG-Based Emotion Classification Using a Deep Neural Network and Sparse Autoencoder," Frontiers in Systems Neuroscience, vol. 14, Sep. 2020, doi: 10.3389/fnsys.2020.00043.
[37] W.-L. Zheng, J.-Y. Zhu, and B.-L. Lu, "Identifying Stable Patterns over Time for Emotion Recognition from EEG," Jan. 2016, [Online]. Available: http://arxiv.org/abs/1601.02197
[38] Y. Luo, L.-Z. Zhu, Z.-Y. Wan, and B.-L. Lu, "Data Augmentation for Enhancing EEG-based Emotion Recognition with Deep Generative Models," Jun. 2020, [Online].

Downloads: 11271
Visits: 239978

Sponsors, Associates, and Links


All published work is licensed under a Creative Commons Attribution 4.0 International License.

Copyright © 2016 - 2031 Clausius Scientific Press Inc. All Rights Reserved.