EUROSPEECH 2001 Scandinavia
7th European Conference on Speech Communication and Technology
2nd INTERSPEECH Event

Aalborg, Denmark
September 3-7, 2001

                 

Using Aerial and Geometric Features in Automatic Lip-Reading

Jacek C. Wojdel, Leon J. M. Rothkrantz

Delft University of Technology, The Netherlands

In this paper we present the lip-reading experiments with different sets of the features extracted from the video sequence. In our experiments we use a simple color based filtering techniques to extract the feature vectors from the incoming video signal. Some of those features are directly related to the geometrical properties of the lips (their position and visible thickness). Other features represent the information that relates to the visibility of the other components of the speech production system. The visibility of the teeth and vocal tract for example is described by means of the area they occupy in the image, we call them therefore the aerial features.

Full Paper

Bibliographic reference.  Wojdel, Jacek C. / Rothkrantz, Leon J. M. (2001): "Using aerial and geometric features in automatic lip-reading", In EUROSPEECH-2001, 2463-2466.