Fourth European Conference on Speech Communication and Technology

Madrid, Spain
September 18-21, 1995

Optimizing Lexical and N-gram Coverage Via Judicious Use of Linguistic Data

Ronald Rosenfeld

School of Computer Science, Carnegie Mellon University, Pittsburgh, Pennsylvania, USA

I study the effect of various types and amounts of North American Business language data on the quality of the derived vocabulary, and use my findings to derive an improved ranking of the words, using only 19% of the NAB corpus. I then study the conflicting effects of increased vocabulary size on a speech recognizer's accuracy, and use the result to pick an optimal vocabulary size. A similar analysis of ngram coverage yields a very different outcome, with the best system being the one based on the most data.

Full Paper

Bibliographic reference.  Rosenfeld, Ronald (1995): "Optimizing lexical and n-gram coverage via judicious use of linguistic data", In EUROSPEECH-1995, 1763-1766.