02633nas a2200397 4500008004100000022001400041245003700055210003700092300001100129490000600140520152800146653003301674653003201707653003001739653002001769653002601789653001701815653002601832653001901858653001001877653002001887653001701907653002101924653002001945653003601965653002002001653002402021653001902045653001802064653002202082653001802104653001802122100001402140700001702154856006402171 2010 eng d a1943-060400aInfomax Control of Eye Movements0 aInfomax Control of Eye Movements a91-1070 v23 a

Recently, infomax methods of optimal control have begun to reshape how we think about active information gathering. We show how such methods can be used to formulate the problem of choosing where to look. We show how an optimal eye movement controller can be learned from subjective experiences of information gathering, and we explore in simulation properties of the optimal controller. This controller outperforms other eye movement strategies proposed in the literature. The learned eye movement strategies are tailored to the specific visual system of the learner-we show that agents with different kinds of eyes should follow different eye movement strategies. Then we use these insights to build an autonomous computer program that follows this approach and learns to search for faces in images faster than current state-of-the-art techniques. The context of these results is search in static scenes, but the approach extends easily, and gives further efficiency gains, to dynamic tracking tasks. A limitation of infomax methods is that they require probabilistic models of uncertainty of the sensory system, the motor system, and the external world. In the final section of this paper, we propose future avenues of research by which autonomous physical agents may use developmental experience to subjectively characterize the uncertainties they face.

10aactive information gathering10aautonomous computer program10aautonomous physical agent10aComputer vision10adynamic tracking task10aEye movement10aeye movement strategy10aface detection10afaces10aInfomax control10amotor system10aobject detection10aoptimal control10aoptimal eye movement controller10apolicy gradient10aprobabilistic model10asensory system10astatic scenes10aVisual Perception10avisual search10avisual system1 aButko, N.1 aMovellan, J. uhttps://rubi.ucsd.edu/content/infomax-control-eye-movements03033nas a2200565 4500008004100000022001400041245003700055210003700092260001200129300001400141490000700155520134500162653001501507653002801522653001401550653005301564653003501617653001301652653002401665653002001689653002201709653000901731653003301740653002101773653002701794653004801821653002801869653002001897653002201917653002501939653004401964653003902008653003202047653002802079653001302107653002102120653003002141653003102171653003202202653001202234653002602246653002202272653002102294100001802315700001902333700001402352700001702366700001702383856006702400 2009 eng d a0162-882800aToward Practical Smile Detection0 aToward Practical Smile Detection c11/2009 a2106-21110 v313 a

Machine learning approaches have produced some of the highest reported performances for facial expression recognition. However, to date, nearly all automatic facial expression recognition research has focused on optimizing performance on a few databases that were collected under controlled lighting conditions on a relatively small number of subjects. This paper explores whether current machine learning methods can be used to develop an expression recognition system that operates reliably in more realistic conditions. We explore the necessary characteristics of the training data set, image registration, feature representation, and machine learning algorithms. A new database, GENKI, is presented which contains pictures, photographed by the subjects themselves, from thousands of different people in many different real-world imaging conditions. Results suggest that human-level expression recognition accuracy in real-life illumination conditions is achievable with machine learning technology. However, the data sets currently used in the automatic expression recognition literature to evaluate progress may be overly constrained and could potentially lead research into locally optimal algorithmic solutions.

10aAlgorithms10aArtificial intelligence10aAutomated10aautomatic facial expression recognition research10aBiological Pattern Recognition10aBiometry10aComputer simulation10aComputer vision10aComputer-Assisted10aFace10aFace and gesture recognition10aface recognition10afeature representation10ahuman-level expression recognition accuracy10aillumination conditions10aImage databases10aImage Enhancement10aImage Interpretation10aimage registration image representation10alearning (artificial intelligence)10amachine learning approaches10aMachine Learning Models10an Humans10aobject detection10apractical smile detection10aReproducibility of Results10aSensitivity and Specificity10aSmiling10aSubtraction Technique10atraining data set10avisual databases1 aWhitehill, J.1 aLittlewort, G.1 aFasel, I.1 aBartlett, M.1 aMovellan, J. uhttps://rubi.ucsd.edu/content/toward-practical-smile-detection02714nas a2200361 4500008004100000020002200041245006200063210006200125260003200187520158600219653002801805653002001833653002201853653002301875653002401898653003001922653001901952653001201971653003601983653003902019653002102058653002002079653002302099653003502122653001602157653001702173653001102190653001702201100001502218700001402233700001702247856008802264 2008 eng d a978-1-4244-1646-200aAuditory mood detection for social and educational robots0 aAuditory mood detection for social and educational robots aPasadena, CAbIEEEc05/20083 a

Social robots face the fundamental challenge of detecting and adapting their behavior to the current social mood. For example, robots that assist teachers in early education must choose different behaviors depending on whether the children are crying, laughing, sleeping, or singing songs. Interactive robotic applications require perceptual algorithms that both run in real time and are adaptable to the challenging conditions of daily life. This paper explores a novel approach to auditory mood detection which was born out of our experience immersing social robots in classroom environments. We propose a new set of low-level spectral contrast features that extends a class of features which have proven very successful for object recognition in the modern computer vision literature. Features are selected and combined using machine learning approaches so as to make decisions about the ongoing auditory mood. We demonstrate excellent performance on two standard emotional speech databases (the Berlin Emotional Speech [W. Burkhardt et al., 2005], and the ORATOR dataset [H. Quast, 2001]). In addition we establish strong baseline performance for mood detection on a database collected from a social robot immersed in a classroom of 18-24 months old children [J. Movellan er al., 2007]. This approach operates in real time at little computational cost. It has the potential to greatly enhance the effectiveness of social robots in daily life environments.

10aauditory mood detection10aComputer vision10aeducational robot10aEducational robots10aEmotion recognition10aemotional speech database10aface detection10ahearing10ainteractive robotic application10alearning (artificial intelligence)10aMachine Learning10aMood Prototypes10aobject recognition10aRobotics and Automation Robots10asocial mood10asocial robot10aSpeech10aUSA Councils1 aRuvolo, P.1 aFasel, I.1 aMovellan, J. uhttps://rubi.ucsd.edu/content/auditory-mood-detection-social-and-educational-robots