Automated facial affect analysis for one-on-one tutoring applications

TitleAutomated facial affect analysis for one-on-one tutoring applications
Publication TypeConference Paper
Year of Publication2011
AuthorsButko, N, Theocharous, G, Philipose, M, Movellan, J
Conference Name2011 IEEE International Conference on Automatic Face Gesture Recognition and Workshops (FG 2011)
Date Published03/2011
Conference LocationSanta Barbara, CA
ISBN Number978-1-4244-9140-7
Accession Number12007758
Keywordsautomated facial affect analysis, automated tutoring system, behavioural sciences computing, computer vision technique, Context, decision making, education, Emotion recognition, face recognition, Human, human computer interaction, Labeling, Machine Learning, Mood, n Histograms, one-on-one tutoring application, s Intelligent tutoring systems, student mood analysis

In this paper, we explore the use of computer vision techniques to analyze students' moods during one-on-one teaching interactions. The eventual goal is to create automated tutoring systems that are sensitive to the student's mood and affective state. We find that the problem of accurately determining a child's mood from a single video frame is surprisingly difficult, even for humans. However when the system is allowed to make decisions based on information from 10 to 30 seconds of video, excellent performance may be obtained.