Skip to main navigation Skip to search Skip to main content

Using facial expression to detect emotion in e-learning system: A deep learning method

  • Ai Sun
  • , Ying Jian Li*
  • , Yueh Min Huang
  • , Qiong Li
  • *Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

E-learning system is becoming more and more popular among students nowadays. However, the emotion of students is usually neglected in e-learning system. This study is mainly concerned about using facial expression to detect emotion in e-learning system. A deep learning method called convolutional neural network (CNN) is used in our research. Firstly, CNN is introduced to detect emotion in e-learning system based on using facial expression in this paper. Secondly, the training process and testing process of CNN are described. To learn about the accuracy of CNN in emotion detection, three databases (CK+, JAFFE and NVIE) are chosen to train and test the model. 10-fold cross validation method is used to calculate the accuracy. Thirdly, we introduce how to apply the trained CNN to e-learning system, and the design of e-learning system with emotion detection module is given. At last, we propose the design of an experiment to evaluate the performance of this method in real e-learning system.

Original languageEnglish
Title of host publicationEmerging Technologies for Education - 2nd International Symposium, SETE 2017, Held in Conjunction with ICWL 2017, Revised Selected Papers
EditorsTien-Chi Huang, Rynson Lau, Yueh-Min Huang, Marc Spaniol, Chun-Hung Yuen
PublisherSpringer Verlag
Pages446-455
Number of pages10
ISBN (Print)9783319710839
DOIs
StatePublished - 2017
Externally publishedYes
Event2nd International Symposium on Emerging Technologies for Education, SETE 2017, held in Conjunction with the 16th International Conference on Web-based learning, ICWL 2017 - Cape Town, South Africa
Duration: 20 Sep 201722 Sep 2017

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume10676 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference2nd International Symposium on Emerging Technologies for Education, SETE 2017, held in Conjunction with the 16th International Conference on Web-based learning, ICWL 2017
Country/TerritorySouth Africa
CityCape Town
Period20/09/1722/09/17

Keywords

  • Deep learning
  • E-learning
  • Emotion detection
  • Facial expression

Fingerprint

Dive into the research topics of 'Using facial expression to detect emotion in e-learning system: A deep learning method'. Together they form a unique fingerprint.

Cite this