Ninth International Conference on Spoken Language Processing

Pittsburgh, PA, USA
September 17-21, 2006

Low Complexity LID Using Pruned Pattern Tables of LZW

S. V. Basavaraja, T. V. Sreenivas

Indian Institute of Science, India

We present two discriminative language modelling techniques for Lempel-Ziv-Welch (LZW) based LID system. The previous approach to LID using LZW algorithm was to directly use the LZW pattern tables for language modelling. But, since the patterns in a language pattern table are shared by other language pattern tables, confusability prevailed in the LID task. For overcoming this, we present two pruning techniques (i) Language Specific (LS-LZW) - in which patterns common to more than one pattern table are removed. (ii) Length-Frequency product based (LF-LZW) - in which patterns having their length-frequency product below a threshold are removed. These approaches reduce the classification score (Compression Ratio [LZW-CR] or the weighted discriminant score [LZW-WDS]) for non native languages and increases the LID performance considerably. Also the memory and computational requirements of these techniques are much less compared to basic LZW techniques.

Full Paper

Bibliographic reference.  Basavaraja, S. V. / Sreenivas, T. V. (2006): "Low complexity LID using pruned pattern tables of LZW", In INTERSPEECH-2006, paper 1398-Mon2CaP.4.