A Deep Reinforcement Learning Based Emotional State Analysis Method for Online Learning
DOI: 10.23977/jaip.2022.050210 | Downloads: 22 | Views: 801
Author(s)
Jin Lu 1
Affiliation(s)
1 Guangdong Key Laboratory of Big Data Intelligence for Vocational Education, Shenzhen Polytechnic, Shenzhen, Guangdong, 518055, China
Corresponding Author
Jin LuABSTRACT
With the development of artificial intelligence technology, the basic judgment of students' learning state can be realized through the comprehensive analysis of students' face, expression, behavior posture and other multi-modal data. However, due to the lack of end-to-end recognition model and complete data sets, it is impossible to achieve accurate analysis of learning status. In this paper, based on deep reinforcement learning, an online learning state analysis method based on affective computing is proposed. On the basis of student identity recognition, face recognition is carried out through an unsupervised expression recognition model based on Siam-RCNN, and then 3D CNNs is used to recognize the feature data set for timing extraction. The state of collaborative awareness learning is analyzed by using HMM model. After verification, the accuracy of emotional state recognition can reach 98.88%, which is in the leading level in the industry.
KEYWORDS
Affective Computing, Deep Reinforcement Learning, Expression data, Learning StatusCITE THIS PAPER
Jin Lu, A Deep Reinforcement Learning Based Emotional State Analysis Method for Online Learning. Journal of Artificial Intelligence Practice (2022) Vol. 5: 71-80. DOI: http://dx.doi.org/10.23977/jaip.2022.050210.
REFERENCES
[1] Koelstra S, Muhl C, Soleymani M, et al. DEAP: A Database for Emotion Analysis; Using Physiological Signals [J]. IEEE Transactions on Affective Computing, 2012, 3(1): 18-31.
[2] Hao Zheng, Xin Geng, Zhongxue Yang. A Relaxed K-SVD Algorithm for Spontaneous Micro-Expression Recognition [J]. 2016.
[3] Merghani W, Davison A K, Yap M H, et al. The implication of spatial temporal changes on facial micro-expression analysis [J]. Multimedia Tools and Applications, 2019, 78(15): 21613-21628.
[4] Patel D, Hong X, Zhao G, et al. Selective deep features for micro-expression recognition [C]. International conference on pattern recognition, 2016: 2258-2263.
[5] Peng M, Wang C, Bi T, et al. A Novel Apex-Time Network for Cross-Dataset Micro-Expression Recognition[C].// 8th International Conference on Affective Computing and Intelligent Interaction (ACII). 2019.
[6] Wang C, Peng M, Bi T, et al. Micro-Attention for Micro-Expression recognition.[J]. arXiv: Computer Vision and Pattern Recognition, 2018.
[7] Khor H Q, See J, Phan R C W, et al. Enriched Long-term Recurrent Convolutional Network for Facial Micro-Expression Recognition [J]. 2018.
[8] Xia Z, Hong X, Gao X, et al. Spatiotemporal Recurrent Convolutional Networks for Recognizing Spontaneous Micro-Expressions[J]. IEEE Transactions on Multimedia, 2020, 22(3): 626-640.
[9] Verburg M, Menkovski V. Micro-expression detection in long videos using optical flow and recurrent neural networks[C]. ieee international conference on automatic face gesture recognition, 2019.
[10] Khor H Q, See J, Phan R, et al. Enriched Long-term Recurrent Convolutional Network for Facial Micro-Expression Recognition[C].// IEEE International Conference on Automatic Face & Gesture Recognition. arXiv, 2018.
[11] Voigtlaender P, Luiten J, Torr P, et al. Siam R-CNN: Visual Tracking by Re-Detection [J]. 2019.
[12] Vara P, D'Souzakevin B, Bhargavavijay K. A Downscaled Faster-RCNN Framework for Signal Detection and Time-Frequency Localization in Wideband RF Systems [J]. IEEE Transactions on Wireless Communications, 2020.
[13] Ren X, Lei X, Dong N, et al. Interleaved 3D-CNNs for Joint Segmentation of Small-Volume Structures in Head and Neck CT Images [J]. Medical Physics, 2018, 45(5).
[14] Schroff F, Kalenichenko D, Philbin J. FaceNet: A Unified Embedding for Face Recognition and Clustering[C].// 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 2015.
[15] Liu W, Wen Y, Yu Z, et al. SphereFace: Deep Hypersphere Embedding for Face Recognition[C].// 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 2017.
[16] Deng J, Guo J, Zafeiriou S. ArcFace: Additive Angular Margin Loss for Deep Face Recognition [J]. 2018.
[17] Johannes S. Protein homology detection by HMM–HMM comparison [J]. Bioinformatics, 2005(7):951-960.
[18] Wang H, Song Z. Improved Mosaic: Algorithms for more Complex Images [J]. Journal of Physics Conference Series, 2020, 1684:012094.
[19] Chen Y, Weng Q, Tang L, et al. Thick Clouds Removing From Multitemporal Landsat Images Using Spatiotemporal Neural Networks [J]. IEEE Transactions on Geoscience and Remote Sensing, 2020, PP (99):1-14.
[20] Wang H, Wang Y, Zhou Z, et al. CosFace: Large Margin Cosine Loss for Deep Face Recognition[C].// 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. IEEE, 2018.
[21] Schroff F, Kalenichenko D, Philbin J. FaceNet: A Unified Embedding for Face Recognition and Clustering[C].// 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 2015.
[22] Liu W, Wen Y, Yu Z, et al. SphereFace: Deep Hypersphere Embedding for Face Recognition[C].// 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 2017.
[23] Gyawali D, Pokharel P, Chauhan A, et al. Age Range Estimation using MTCNN and VGG-Face Model[J]. 2021.
Downloads: | 5214 |
---|---|
Visits: | 171580 |
Sponsors, Associates, and Links
-
Power Systems Computation
-
Internet of Things (IoT) and Engineering Applications
-
Computing, Performance and Communication Systems
-
Advances in Computer, Signals and Systems
-
Journal of Network Computing and Applications
-
Journal of Web Systems and Applications
-
Journal of Electrotechnology, Electrical Engineering and Management
-
Journal of Wireless Sensors and Sensor Networks
-
Journal of Image Processing Theory and Applications
-
Mobile Computing and Networking
-
Vehicle Power and Propulsion
-
Frontiers in Computer Vision and Pattern Recognition
-
Knowledge Discovery and Data Mining Letters
-
Big Data Analysis and Cloud Computing
-
Electrical Insulation and Dielectrics
-
Crypto and Information Security
-
Journal of Neural Information Processing
-
Collaborative and Social Computing
-
International Journal of Network and Communication Technology
-
File and Storage Technologies
-
Frontiers in Genetic and Evolutionary Computation
-
Optical Network Design and Modeling
-
Journal of Virtual Reality and Artificial Intelligence
-
Natural Language Processing and Speech Recognition
-
Journal of High-Voltage
-
Programming Languages and Operating Systems
-
Visual Communications and Image Processing
-
Journal of Systems Analysis and Integration
-
Knowledge Representation and Automated Reasoning
-
Review of Information Display Techniques
-
Data and Knowledge Engineering
-
Journal of Database Systems
-
Journal of Cluster and Grid Computing
-
Cloud and Service-Oriented Computing
-
Journal of Networking, Architecture and Storage
-
Journal of Software Engineering and Metrics
-
Visualization Techniques
-
Journal of Parallel and Distributed Processing
-
Journal of Modeling, Analysis and Simulation
-
Journal of Privacy, Trust and Security
-
Journal of Cognitive Informatics and Cognitive Computing
-
Lecture Notes on Wireless Networks and Communications
-
International Journal of Computer and Communications Security
-
Journal of Multimedia Techniques
-
Automation and Machine Learning
-
Computational Linguistics Letters
-
Journal of Computer Architecture and Design
-
Journal of Ubiquitous and Future Networks