4th International Conference on Spoken Language Processing

Philadelphia, PA, USA
October 3-6, 1996

A Theory of Word Frequencies and its Application to Dialogue Move Recognition

Phil Garner, Sue Browning, Roger Moore, Martin Russell

Defence Research Agency, Malvern, Worcs., UK

Dialogue move recognition is taken as being representative of a class of spoken language applications where inference about high level semantic meaning is required from lower level acoustic, phonetic or word based features. Topic identification is another such application. In the particular case of inference from words, the multinomial distribution is shown to be inadequate for modelling word frequencies, and the multivariate Poisson is a more reasonable choice. Zipf's law is used to model a prior distribution. This more rigorous mathematical formulation is shown to improve dialogue move classiffcation both subjectively and quantitatively.

Full Paper

Bibliographic reference.  Garner, Phil / Browning, Sue / Moore, Roger / Russell, Martin (1996): "A theory of word frequencies and its application to dialogue move recognition", In ICSLP-1996, 1880-1883.