4th International Conference on Spoken Language Processing

Philadelphia, PA, USA
October 3-6, 1996

Feature Dimension Reduction Using Reduced-Rank Maximum Likelihood Estimation for Hidden Markov Models

Don X. Sun

Statistics and Information Analysis Research, Bell Laboratories, Lucent Technologies, Murray Hill, NJ, USA

This paper presents a new method of feature dimension reduction in hidden Markov modeling (HMM) for speech recognition. The key idea is to apply reduced rank maximum likelihood estimation in the M-step of the usual Baum-Welch algorithm for estimating HMM parameters such that the estimates of the Gaussian distribution parameters are restricted in a sub-space of reduced dimensionality. There are two main advantages of applying this method in HMM: 1) feature dimension reduction is achieved simultaneously with the estimation of HMM parameters, therefore it guarantees that the likelihood function is monotonically increasing; 2) it requires very little extra computation in addition to the standard Baum-Welch algorithm, hence it can be easily incorporated in the existing speech recognition systems using HMMs.

Full Paper

Bibliographic reference.  Sun, Don X. (1996): "Feature dimension reduction using reduced-rank maximum likelihood estimation for hidden Markov models", In ICSLP-1996, 244-247.