4th International Conference on Spoken Language Processing

Philadelphia, PA, USA
October 3-6, 1996

Clustered Language Models with Context-Equivalent States

J. P. Ueberla (1), I. R. Gransden (2)

(1) Forum Technology, DRA Malvern, Worcestershire, UK
(2) Speech Research Unit, DRA Malvern, Worcestershire, UK

In this paper, a hierarchical context definition is added to an existing clustering algorithm in order to increase its robustness. The resulting algorithm, which clusters contexts and events separately, is used to experiment with different ways of defining the context a language model takes into account. The contexts range from standard bigram and trigram contexts to part of speech five-grams. Although none of the models can compete directly with a backoff trigram, they give up to 9% improvement in perplexity when interpolated with a trigram. Moreover, the modified version of the algorithm leads to a performance increase over the original version of up to 12%.

Full Paper

Bibliographic reference.  Ueberla, J. P. / Gransden, I. R. (1996): "Clustered language models with context-equivalent states", In ICSLP-1996, 2060-2062.