Education, Science, Technology, Innovation and Life
Open Access
Sign In

A Deep Reinforcement Learning Based Emotional State Analysis Method for Online Learning

Download as PDF

DOI: 10.23977/jaip.2022.050210 | Downloads: 22 | Views: 801

Author(s)

Jin Lu 1

Affiliation(s)

1 Guangdong Key Laboratory of Big Data Intelligence for Vocational Education, Shenzhen Polytechnic, Shenzhen, Guangdong, 518055, China

Corresponding Author

Jin Lu

ABSTRACT

With the development of artificial intelligence technology, the basic judgment of students' learning state can be realized through the comprehensive analysis of students' face, expression, behavior posture and other multi-modal data. However, due to the lack of end-to-end recognition model and complete data sets, it is impossible to achieve accurate analysis of learning status. In this paper, based on deep reinforcement learning, an online learning state analysis method based on affective computing is proposed. On the basis of student identity recognition, face recognition is carried out through an unsupervised expression recognition model based on Siam-RCNN, and then 3D CNNs is used to recognize the feature data set for timing extraction. The state of collaborative awareness learning is analyzed by using HMM model. After verification, the accuracy of emotional state recognition can reach 98.88%, which is in the leading level in the industry.

KEYWORDS

Affective Computing, Deep Reinforcement Learning, Expression data, Learning Status

CITE THIS PAPER

Jin Lu, A Deep Reinforcement Learning Based Emotional State Analysis Method for Online Learning. Journal of Artificial Intelligence Practice (2022) Vol. 5: 71-80. DOI: http://dx.doi.org/10.23977/jaip.2022.050210.

REFERENCES

[1] Koelstra S, Muhl C, Soleymani M, et al. DEAP: A Database for Emotion Analysis; Using Physiological Signals [J]. IEEE Transactions on Affective Computing, 2012, 3(1): 18-31.
[2] Hao Zheng, Xin Geng, Zhongxue Yang. A Relaxed K-SVD Algorithm for Spontaneous Micro-Expression Recognition [J]. 2016.
[3] Merghani W, Davison A K, Yap M H, et al. The implication of spatial temporal changes on facial micro-expression analysis [J]. Multimedia Tools and Applications, 2019, 78(15): 21613-21628.
[4] Patel D, Hong X, Zhao G, et al. Selective deep features for micro-expression recognition [C]. International conference on pattern recognition, 2016: 2258-2263.
[5] Peng M, Wang C, Bi T, et al. A Novel Apex-Time Network for Cross-Dataset Micro-Expression Recognition[C].// 8th International Conference on Affective Computing and Intelligent Interaction (ACII). 2019.
[6] Wang C, Peng M, Bi T, et al. Micro-Attention for Micro-Expression recognition.[J]. arXiv: Computer Vision and Pattern Recognition, 2018.
[7] Khor H Q, See J, Phan R C W, et al. Enriched Long-term Recurrent Convolutional Network for Facial Micro-Expression Recognition [J]. 2018.
[8] Xia Z, Hong X, Gao X, et al. Spatiotemporal Recurrent Convolutional Networks for Recognizing Spontaneous Micro-Expressions[J]. IEEE Transactions on Multimedia, 2020, 22(3): 626-640.
[9] Verburg M, Menkovski V. Micro-expression detection in long videos using optical flow and recurrent neural networks[C]. ieee international conference on automatic face gesture recognition, 2019.
[10] Khor H Q, See J, Phan R, et al. Enriched Long-term Recurrent Convolutional Network for Facial Micro-Expression Recognition[C].// IEEE International Conference on Automatic Face & Gesture Recognition. arXiv, 2018.
[11] Voigtlaender P, Luiten J, Torr P, et al. Siam R-CNN: Visual Tracking by Re-Detection [J]. 2019.
[12] Vara P, D'Souzakevin B, Bhargavavijay K. A Downscaled Faster-RCNN Framework for Signal Detection and Time-Frequency Localization in Wideband RF Systems [J]. IEEE Transactions on Wireless Communications, 2020.
[13] Ren X, Lei X, Dong N, et al. Interleaved 3D-CNNs for Joint Segmentation of Small-Volume Structures in Head and Neck CT Images [J]. Medical Physics, 2018, 45(5).
[14] Schroff F, Kalenichenko D, Philbin J. FaceNet: A Unified Embedding for Face Recognition and Clustering[C].// 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 2015.
[15] Liu W, Wen Y, Yu Z, et al. SphereFace: Deep Hypersphere Embedding for Face Recognition[C].// 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 2017.
[16] Deng J, Guo J, Zafeiriou S. ArcFace: Additive Angular Margin Loss for Deep Face Recognition [J]. 2018.
[17] Johannes S. Protein homology detection by HMM–HMM comparison [J]. Bioinformatics, 2005(7):951-960.
[18] Wang H, Song Z. Improved Mosaic: Algorithms for more Complex Images [J]. Journal of Physics Conference Series, 2020, 1684:012094.
[19] Chen Y, Weng Q, Tang L, et al. Thick Clouds Removing From Multitemporal Landsat Images Using Spatiotemporal Neural Networks [J]. IEEE Transactions on Geoscience and Remote Sensing, 2020, PP (99):1-14.
[20] Wang H, Wang Y, Zhou Z, et al. CosFace: Large Margin Cosine Loss for Deep Face Recognition[C].// 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. IEEE, 2018.
[21] Schroff F, Kalenichenko D, Philbin J. FaceNet: A Unified Embedding for Face Recognition and Clustering[C].// 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 2015.
[22] Liu W, Wen Y, Yu Z, et al. SphereFace: Deep Hypersphere Embedding for Face Recognition[C].// 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 2017.
[23] Gyawali D, Pokharel P, Chauhan A, et al. Age Range Estimation using MTCNN and VGG-Face Model[J]. 2021.

Downloads: 5214
Visits: 171580

Sponsors, Associates, and Links


All published work is licensed under a Creative Commons Attribution 4.0 International License.

Copyright © 2016 - 2031 Clausius Scientific Press Inc. All Rights Reserved.