EUROSPEECH 2001 Scandinavia
7th European Conference on Speech Communication and Technology

Aalborg, Denmark
September 3-7, 2001


A Face-To-Muscle Inversion of a Biomechanical Face Model for Audiovisual and Motor Control Research

Michel Pitermann (1), Kevin G. Munhall (2)

(1) INRIA Lorraine, France; (2) Queen's University, Canada

Muscle-based models of the human face produce high quality animation but estimating modeled muscle activities has not been satisfying solved yet. In this paper we present a dynamic inversion of a muscle-based model that permits the animation to be created from kinematic recordings of facial movements. Using a nonlinear optimizer (Powell's algorithm) the inversion produces a muscle activity set for 16 muscle groups in the lower face that minimize the root mean square error between kinematic data recorded with OPTOTRAK and the corresponding nodes of the modeled facial mesh. This inverted muscle activity is then used to animate the facial model. The results of a first experiment showed that the inversion-synthesis method can accurately reproduce a synthetic facial animation, even for a partial sampling of the face. The results of a second experiment showed that the method is as successful for OPTOTRAK recording of a talker uttering a sentence.

Full Paper

Bibliographic reference.  Pitermann, Michel / Munhall, Kevin G. (2001): "A face-to-muscle inversion of a biomechanical face model for audiovisual and motor control research", In EUROSPEECH-2001, 1511-1514.