5th European Conference on Speech Communication and Technology

Rhodes, Greece
September 22-25, 1997

Within-Speaker Variability of the Word Error Rate for a Continuous Speech Recognition System

David A. van Leeuwen, Herman J. M. Steeneken

TNO Human Factors Research Institute, Soesterberg, The Netherlands

The variance of the performance of a continuous speech recognition system subjected to replica utterances of the same sentence spoken by the same speaker has been investigated. In an experiment with three different speech recognition systems in three different languages with two different grammar conditions it is shown that the sentence word error rate has a variance that can be described in terms of binomial statistics. The distribution of the measured variance shows a remarkable correspondence to the parameter-free theoretical distribution. It is therefore concluded that for the word error rate of a continuous speech recognition system binomial statistics apply.

Full Paper

Bibliographic reference.  Leeuwen, David A. van / Steeneken, Herman J. M. (1997): "Within-speaker variability of the word error rate for a continuous speech recognition system", In EUROSPEECH-1997, 1915-1918.