Human Face Animation Based on Video Analysis, with Applications to Mobile Entertainment

Abstract

In this paper, we present a novel non-uniform rational B-spline (NURBS) muscle system for the simulation of human facial expressions and talking animation based on features extracted from video sequences. We construct the facial muscles based on anatomical knowledge and NURBS models. We use 43 feature points to represent facial expressions and apply a lip contour extraction technique to determine lip shapes. Our system is able to generate many different facial expressions and mouth shapes. The system has been used in web and mobile phone based digital entertainment applications.