In this paper, we explore the use of computer vision techniques to analyze students' moods during one-on-one teaching interactions. The eventual goal is to create automated tutoring systems that are sensitive to the student's mood and affective state. We find that the problem of accurately determining a child's mood from a single video frame is surprisingly difficult, even for humans. However when the system is allowed to make decisions based on information from 10 to 30 seconds of video, excellent performance may be obtained.
10 aautomated facial affect analysis 10 aautomated tutoring system 10 abehavioural sciences computing 10 acomputer vision technique 10 aContext 10 adecision making 10 aeducation 10 aEmotion recognition 10 aface recognition 10 aHuman 10 ahuman computer interaction 10 aLabeling 10 aMachine Learning 10 aMood 10 an Histograms 10 aone-on-one tutoring application 10 as Intelligent tutoring systems 10 astudent mood analysis 1 aButko, N. 1 aTheocharous, G. 1 aPhilipose, M. 1 aMovellan, J. uhttps://rubi.ucsd.edu/content/automated-facial-affect-analysis-one-one-tutoring-applications 02299nas a2200445 4500008004100000020002200041245005500063210004900118260003700167520099600204653001901200653001301219653005401232653000901286653004401295653001401339653002101353653002401374653001301398653002501411653000901436653002101445653003701466653003001503653002001533653000901553653000901562653001701571653001801588653001901606653003901625100001901664700001801683700001101701700001401712700001401726700001701740700001701757856007901774 2011 eng d a978-1-4244-9140-7 00 aThe computer expression recognition toolbox (CERT) 0 acomputer expression recognition toolbox CERT aSanta Barbara, CA bIEEE c03/2011 3 aWe present the Computer Expression Recognition Toolbox (CERT), a software tool for fully automatic real-time facial expression recognition, and officially release it for free academic use. CERT can automatically code the intensity of 19 different facial actions from the Facial Action Unit Coding System (FACS) and 6 different prototypical facial expressions. It also estimates the locations of 10 facial features as well as the 3-D orientation (yaw, pitch, roll) of the head. On a database of posed facial expressions, Extended Cohn-Kanade (CK+[1]), CERT achieves an average recognition performance (probability of correctness on a two-alternative forced choice (2AFC) task between one positive and one negative example) of 90.1% when analyzing facial actions. On a spontaneous facial expression dataset, CERT achieves an accuracy of nearly 80%. In a standard dual core laptop, CERT can process 320 × 240 video images in real time at approximately 10 frames per second.
10 a3D orientation 10 aAccuracy 10 aautomatic real-time facial expression recognition 10 aCERT 10 acomputer expression recognition toolbox 10 aDetectors 10 adual core laptop 10 aEmotion recognition 10 aEncoding 10 aextended Cohn-Kanade 10 aFace 10 aface recognition 10 afacial action unit coding system 10 afacial expression dataset 10 aFacial features 10 aFACS 10 aGold 10 aImage coding 10 asoftware tool 10 asoftware tools 10 atwo-alternative forced choice task 1 aLittlewort, G. 1 aWhitehill, J. 1 aWu, T. 1 aFasel, I. 1 aFrank, M. 1 aMovellan, J. 1 aBartlett, M. uhttps://rubi.ucsd.edu/content/computer-expression-recognition-toolbox-cert 01688nas a2200385 4500008004100000020002200041245004000063210004000103260002800143520060700171653001400778653002400792653001900816653002100835653002800856653001300884653001100897653003900908653002100947653001900968653001500987653004401002653002601046653001701072653001101089653002501100653002001125653001601145100001101161700001401172700001501186700001701201700001701218856006701235 2009 eng d a978-1-4244-4117-4 00 aLearning to Make Facial Expressions 0 aLearning to Make Facial Expressions aShanghai bIEEE c06/2009 3 aThis paper explores the process of self-guided learning of realistic facial expression production by a robotic head with 31 degrees of freedom. Facial motor parameters were learned using feedback from real-time facial expression recognition from video. The experiments show that the mapping of servos to expressions was learned in under one-hour of training time. We discuss how our work may help illuminate the computational study of how infants learn to make facial expressions.
10 aActuators 10 aEmotion recognition 10 aface detection 10 aface recognition 10 afacial motor parameters 10 aFeedback 10 aHumans 10 alearning (artificial intelligence) 10 aMachine Learning 10 aMagnetic heads 10 aPediatrics 10 areal-time facial expression recognition 10 aRobot sensing systems 10 arobotic head 10 aRobots 10 aself-guided learning 10 aServomechanisms 10 aServomotors 1 aWu, T. 1 aButko, N. 1 aRuvulo, P. 1 aBartlett, M. 1 aMovellan, J. uhttps://rubi.ucsd.edu/content/learning-make-facial-expressions 03033nas a2200565 4500008004100000022001400041245003700055210003700092260001200129300001400141490000700155520134500162653001501507653002801522653001401550653005301564653003501617653001301652653002401665653002001689653002201709653000901731653003301740653002101773653002701794653004801821653002801869653002001897653002201917653002501939653004401964653003902008653003202047653002802079653001302107653002102120653003002141653003102171653003202202653001202234653002602246653002202272653002102294100001802315700001902333700001402352700001702366700001702383856006702400 2009 eng d a0162-8828 00 aToward Practical Smile Detection 0 aToward Practical Smile Detection c11/2009 a2106-2111 0 v31 3 aMachine learning approaches have produced some of the highest reported performances for facial expression recognition. However, to date, nearly all automatic facial expression recognition research has focused on optimizing performance on a few databases that were collected under controlled lighting conditions on a relatively small number of subjects. This paper explores whether current machine learning methods can be used to develop an expression recognition system that operates reliably in more realistic conditions. We explore the necessary characteristics of the training data set, image registration, feature representation, and machine learning algorithms. A new database, GENKI, is presented which contains pictures, photographed by the subjects themselves, from thousands of different people in many different real-world imaging conditions. Results suggest that human-level expression recognition accuracy in real-life illumination conditions is achievable with machine learning technology. However, the data sets currently used in the automatic expression recognition literature to evaluate progress may be overly constrained and could potentially lead research into locally optimal algorithmic solutions.
10 aAlgorithms 10 aArtificial intelligence 10 aAutomated 10 aautomatic facial expression recognition research 10 aBiological Pattern Recognition 10 aBiometry 10 aComputer simulation 10 aComputer vision 10 aComputer-Assisted 10 aFace 10 aFace and gesture recognition 10 aface recognition 10 afeature representation 10 ahuman-level expression recognition accuracy 10 aillumination conditions 10 aImage databases 10 aImage Enhancement 10 aImage Interpretation 10 aimage registration image representation 10 alearning (artificial intelligence) 10 amachine learning approaches 10 aMachine Learning Models 10 an Humans 10 aobject detection 10 apractical smile detection 10 aReproducibility of Results 10 aSensitivity and Specificity 10 aSmiling 10 aSubtraction Technique 10 atraining data set 10 avisual databases 1 aWhitehill, J. 1 aLittlewort, G. 1 aFasel, I. 1 aBartlett, M. 1 aMovellan, J. uhttps://rubi.ucsd.edu/content/toward-practical-smile-detection 02225nas a2200373 4500008004100000020002200041245006700063210006300130260002900193520104300222653001901265653003001284653003801314653002801352653001901380653002101399653002201420653003801442653001101480653001901491653002001510653001701530653001301547653001901560653003001579653002001609653001501629653003601644653001901680653002001699100001801719700002501737856008901762 2008 eng d a978-1-4244-2153-4 00 aA discriminative approach to frame-by-frame head pose tracking 0 adiscriminative approach to framebyframe head pose tracking aAmsterdam bIEEE c09/2008 3 aWe present a discriminative approach to frame-by-frame head pose tracking that is robust to a wide range of illuminations and facial appearances and that is inherently immune to accuracy drift. Most previous research on head pose tracking has been validated on test datasets spanning only a small (< 20) subjects under controlled illumination conditions on continuous video sequences. In contrast, the system presented in this paper was both trained and tested on a much larger database, GENKI, spanning tens of thousands of different subjects, illuminations, and geographical locations from images on the Web. Our pose estimator achieves accuracy of 5.82deg, 5.65deg, and 2.96deg root-mean-square (RMS) error for yaw, pitch, and roll, respectively. A set of 4000 images from this dataset, labeled for pose, was collected and released for use by the research community.
10 aaccuracy drift 10 acontinuous video sequence 10 acontrolled illumination condition 10 adiscriminative approach 10 aface detection 10 aface recognition 10 afacial appearance 10 aframe-by-frame head pose tracking 10 aHumans 10 aImage analysis 10 aImage databases 10 aLaboratories 10 aLighting 10 aMagnetic heads 10 amean square error methods 10 apose estimation 10 aRobustness 10 aroot-mean-square error tracking 10 aSystem testing 10 aVideo sequences 1 aWhitehill, J. 1 aMovellan, Javier, R. uhttps://rubi.ucsd.edu/content/discriminative-approach-frame-frame-head-pose-tracking