Geometry vs. Appearance for Discriminating between Posed and Spontaneous Emotions
File version
Accepted Manuscript (AM)
Author(s)
Tjondronegoro, Dian
Chandran, Vinod
Griffith University Author(s)
Primary Supervisor
Other Supervisors
Editor(s)
Lu, BL
Zhang, LQ
Kwok, J
Date
Size
File type(s)
Location
Shanghai, China
License
Abstract
Spontaneous facial expressions differ from posed ones in appearance, timing and accompanying head movements. Still images cannot provide timing or head movement information directly. However, indirectly the distances between key points on a face extracted from a still image using active shape models can capture some movement and pose changes. This information is superposed on information about non-rigid facial movement that is also part of the expression. Does geometric information improve the discrimination between spontaneous and posed facial expressions arising from discrete emotions? We investigate the performance of a machine vision system for discrimination between posed and spontaneous versions of six basic emotions that uses SIFT appearance based features and FAP geometric features. Experimental results on the NVIE database demonstrate that fusion of geometric information leads only to marginal improvement over appearance features. Using fusion features, surprise is the easiest emotion (83.4% accuracy) to be distinguished, while disgust is the most difficult (76.1%). Our results find different important facial regions between discriminating posed versus spontaneous version of one emotion and classifying the same emotion versus other emotions. The distribution of the selected SIFT features shows that mouth is more important for sadness, while nose is more important for surprise, however, both the nose and mouth are important for disgust, fear, and happiness. Eyebrows, eyes, nose and mouth are important for anger.
Journal Title
Conference Title
Lecture Notes in Computer Science
Book Title
Edition
Volume
7064
Issue
PART 3
Thesis Type
Degree Program
School
Publisher link
Patent number
Funder(s)
Grant identifier(s)
Rights Statement
Rights Statement
© 2011 Springer-Verlag Berlin Heidelberg . This is the author-manuscript version of this paper. Reproduced in accordance with the copyright policy of the publisher.The original publication is available at www.springerlink.com
Item Access Status
Note
Access the data
Related item(s)
Subject
Information and computing sciences
Science & Technology
Computer Science, Artificial Intelligence
Computer Science, Information Systems
Computer Science, Theory & Methods
Persistent link to this record
Citation
Zhang, L; Tjondronegoro, D; Chandran, V, Geometry vs. Appearance for Discriminating between Posed and Spontaneous Emotions, Lecture Notes in Computer Science, 2011, 7064 (PART 3), pp. 431-440