Ninth International Conference on Spoken Language Processing

Pittsburgh, PA, USA
September 17-21, 2006

Towards Continuous Speech Recognition Using Surface Electromyography

Szu-Chen Jou (1), Tanja Schultz (1), Matthias Walliczek (2), Florian Kraft (2), Alex Waibel (1)

(1) Carnegie Mellon University, USA; (2) Universitšt Karlsruhe, Germany

We present our research on continuous speech recognition of the surface electromyographic signals that are generated by the human articulatory muscles. Previous research on electromyographic speech recognition was limited to isolated word recognition because it was very difficult to train phoneme-based acoustic models for the electromyographic speech recognizer. In this paper, we demonstrate how to train the phoneme-based acoustic models with carefully designed electromyographic feature extraction methods. By decomposing the signal into different feature space, we successfully keep the useful information while reducing the noise. Additionally, we also model the anticipatory effect of the electromyographic signals compared to the speech signal. With a 108-word decoding vocabulary, the experimental results show that the word error rate improves from 86.8% to 32.0% by using our novel feature extraction methods.

Full Paper

Bibliographic reference.  Jou, Szu-Chen / Schultz, Tanja / Walliczek, Matthias / Kraft, Florian / Waibel, Alex (2006): "Towards continuous speech recognition using surface electromyography", In INTERSPEECH-2006, paper 1592-Mon3WeS.3.