First European Conference on Speech Communication and Technology

Paris, France
September 27-29, 1989

Automatic Analysis of Lips and Jaw Kinematics in VCV Sequences

E. Magno Caldognetto (1), K. Vagges (1), N. A. Borghese (2), G. Ferrigno (3)

(1) Centra di Studio per le Ricerche di Fonetica, Univ. di Padova
(2) Istituto di Fisiologia dei Centri Nervosi, CNR, Milano, Italy
(3) Centro di Bioingegneria, Politecnico di Milano, Fondazione Pro Juventute, Milano, Italy

A new system for automatic jaw and lips movement 3D analysis in speech production is presented. The system (ELITE) uses small, non obtrusive, passive markers of .5mm of diameter attached on the speaking subject in six repere points. Two TV cameras survey the scene and the markers are detected by means of a cross-correlation algorithm implemented by a real-time dedicated hardware at a sampling rate of 50Hz. The 3D coordinates of the markers are automatically computed with a standard deviation error of .lmm, by a generalized stereophotogrammetric algorithm which allows a free camera positioning and requires a short time for set-up. The results of preliminary studies on lips rounding movement in coarticulation are presented.

Full Paper

Bibliographic reference.  Caldognetto, E. Magno / Vagges, K. / Borghese, N. A. / Ferrigno, G. (1989): "Automatic analysis of lips and jaw kinematics in VCV sequences", In EUROSPEECH-1989, 2453-2456.