Notice of retraction
Vol. 32, No. 8(2), S&M2292

ISSN (print) 0914-4935
ISSN (online) 2435-0869
Sensors and Materials
is an international peer-reviewed open access journal to provide a forum for researchers working in multidisciplinary fields of sensing technology.
Sensors and Materials
is covered by Science Citation Index Expanded (Clarivate Analytics), Scopus (Elsevier), and other databases.

Instructions to authors
English    日本語

Instructions for manuscript preparation
English    日本語


 Sensors and Materials
 1-23-3-303 Sendagi,
 Bunkyo-ku, Tokyo 113-0022, Japan
 Tel: 81-3-3827-8549
 Fax: 81-3-3827-8547

MYU Research, a scientific publisher, seeks a native English-speaking proofreader with a scientific background. B.Sc. or higher degree is desirable. In-office position; work hours negotiable. Call 03-3827-8549 for further information.

MYU Research

(proofreading and recording)

(translation service)

The Art of Writing Scientific Papers

(How to write scientific papers)
(Japanese Only)

Sensors and Materials, Volume 32, Number 10(1) (2020)
Copyright(C) MYU K.K.
pp. 3243-3259
S&M2336 Research Paper of Special Issue
Published: October 9, 2020

Continuous Facial Emotion Recognition Method Based on Deep Learning of Academic Emotions [PDF]

Szu-Yin Lin, Chao-Ming Wu, Shih-Lun Chen, Ting-Lan Lin, and Yi-Wen Tseng

(Received March 15, 2020; Accepted June 23, 2020)

Keywords: academic emotions, face emotion recognition, deep learning, convolutional neural networks, long short-term memory networks

It is important to comprehend students’ academic emotions in interactive teaching environments. Academic emotions refer to facial expressions that students display along with their academic performance in a learning process. By noting students’ academic emotions, teachers can provide the most suitable teaching material according to the emotions to improve their academic performance and motivation. The results can also be subsequently applied to adaptive learning. Recently, some researchers have attempted to study academic emotions with the aid of facial and emotion recognition technologies. However, most studies focused on the analysis and recognition of a single image. It was not considered that academic emotions are a continuous expression in response to the learning situation over a period of time. To address this problem, a continuous facial emotional pattern recognition method based on deep learning is proposed in this study to analyze academic emotions. This method combines the convolutional neural network (CNN) and the long short-term memory (LSTM) network for deep learning to recognize and analyze the continuous facial academic emotional pattern of students and thus recognize academic emotions. Through this method, the e-learning system can understand the learning progress of students quickly and accurately, and offer the students appropriate teaching materials to enhance their academic performance and motivation. The experimental results showed that the recognition accuracies of the CNN model and CNN plus LSTM were 72.47 and 84.33%, respectively. The combination of two neural networks improved the accuracy by approximately 12% compared with that for the CNN alone.

Corresponding author: Szu-Yin Lin

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.

Cite this article
Szu-Yin Lin, Chao-Ming Wu, Shih-Lun Chen, Ting-Lan Lin, and Yi-Wen Tseng, Continuous Facial Emotion Recognition Method Based on Deep Learning of Academic Emotions, Sens. Mater., Vol. 32, No. 10, 2020, p. 3243-3259.

Forthcoming Regular Issues

Forthcoming Special Issues

Special issue on Novel Materials and Sensing Technologies on Electronic and Mechanical Devices (1)
Guest editor, Teen-Hang Meen (National Formosa University), Wenbing Zhao (Cleveland State University), and Hsien-Wei Tseng (Longyan University)
Call for paper

Special Issue on New Trends in Smart Sensor Systems
Guest editor, Takahiro Hayashi (Kansai University)
Call for paper

Special Issue on Intelligent Sensing Control Analysis, Optimization and Automation
Guest editor, Cheng-Chi Wang (National Chin-Yi University of Technology)

Special Issue on International Conference on BioSensors, BioElectronics, BioMedical Devices, BioMEMS/NEMS and Applications 2019 (Bio4Apps 2019)
Guest editor, Hirofumi Nogami and Masaya Miyazaki (Kyushu University)
Conference website
Call for paper

Special Issue on Materials, Devices, Circuits, and Analytical Methods for Various Sensors (4)
Guest editor, Chien-Jung Huang (National University of Kaohsiung), Cheng-Hsing Hsu (National United University), Ja-Hao Chen (Feng Chia University), and Wei-Ling Hsu (Huaiyin Normal University)
Conference website

Special Issue on Geomatics Technologies for the Realization of Smart Cities (1) and (2)
Guest editor, He Huang and XiangLei Liu (Beijing University of Civil Engineering and Architecture)
Call for paper

Copyright(C) MYU K.K. All Rights Reserved.