Geometry vs. Appearance for Discriminating between Posed and Spontaneous Emotions

Loading...
Thumbnail Image
File version

Accepted Manuscript (AM)

Author(s)
Zhang, Ligang
Tjondronegoro, Dian
Chandran, Vinod
Griffith University Author(s)
Primary Supervisor
Other Supervisors
Editor(s)

Lu, BL

Zhang, LQ

Kwok, J

Date
2011
Size
File type(s)
Location

Shanghai, China

License
Abstract

Spontaneous facial expressions differ from posed ones in appearance, timing and accompanying head movements. Still images cannot provide timing or head movement information directly. However, indirectly the distances between key points on a face extracted from a still image using active shape models can capture some movement and pose changes. This information is superposed on information about non-rigid facial movement that is also part of the expression. Does geometric information improve the discrimination between spontaneous and posed facial expressions arising from discrete emotions? We investigate the performance of a machine vision system for discrimination between posed and spontaneous versions of six basic emotions that uses SIFT appearance based features and FAP geometric features. Experimental results on the NVIE database demonstrate that fusion of geometric information leads only to marginal improvement over appearance features. Using fusion features, surprise is the easiest emotion (83.4% accuracy) to be distinguished, while disgust is the most difficult (76.1%). Our results find different important facial regions between discriminating posed versus spontaneous version of one emotion and classifying the same emotion versus other emotions. The distribution of the selected SIFT features shows that mouth is more important for sadness, while nose is more important for surprise, however, both the nose and mouth are important for disgust, fear, and happiness. Eyebrows, eyes, nose and mouth are important for anger.

Journal Title
Conference Title

Lecture Notes in Computer Science

Book Title
Edition
Volume

7064

Issue

PART 3

Thesis Type
Degree Program
School
Publisher link
Patent number
Funder(s)
Grant identifier(s)
Rights Statement
Rights Statement

© 2011 Springer-Verlag Berlin Heidelberg . This is the author-manuscript version of this paper. Reproduced in accordance with the copyright policy of the publisher.The original publication is available at www.springerlink.com

Item Access Status
Note
Access the data
Related item(s)
Subject

Information and computing sciences

Science & Technology

Computer Science, Artificial Intelligence

Computer Science, Information Systems

Computer Science, Theory & Methods

Persistent link to this record
Citation

Zhang, L; Tjondronegoro, D; Chandran, V, Geometry vs. Appearance for Discriminating between Posed and Spontaneous Emotions, Lecture Notes in Computer Science, 2011, 7064 (PART 3), pp. 431-440