Ninth International Conference on Spoken Language Processing

Pittsburgh, PA, USA
September 17-21, 2006

A Study on Lattice Rescoring with Knowledge Scores for Automatic Speech Recognition

Sabato Marco Siniscalchi, Jinyu Li, Chin-Hui Lee

Georgia Institute of Technology, USA

We study lattice rescoring with knowledge scores for automatic speech recognition. Frame-based log likelihood ratio is adopted as a score measure of the goodness-of-fit between a speech segment and the knowledge sources. We evaluate our approach in two different applications: phone recognition, and connected digit continuous recognition. By incorporating knowledge scores obtained from 15 attribute detectors for place and manner of articulation, we reduced phone error rate from 40.52% to 35.16% using monophone models. The error rate can be further reduced to 33.42% for triphone models. The same lattice rescoring algorithm is extended to connected digit recognition using the TIDIGITS database, and without using any digit-specific training data. We observed the digit error rate can be effectively reduced to 4.03% from 4.54% which was obtained with the conventional Viterbi decoding algorithm with no knowledge scores.

Full Paper

Bibliographic reference.  Siniscalchi, Sabato Marco / Li, Jinyu / Lee, Chin-Hui (2006): "A study on lattice rescoring with knowledge scores for automatic speech recognition", In INTERSPEECH-2006, paper 1319-Mon3A2O.1.