Neural Speech Decoding for Amyotrophic Lateral Sclerosis

Debadatta Dash, Paul Ferrari, Angel Hernandez, Daragh Heitzman, Sara G. Austin, Jun Wang


Amyotrophic lateral sclerosis (ALS) is a motor neuron disease that may cause locked-in syndrome (completely paralyzed but aware). These locked-in patients can communicate with brain-computer interfaces (BCI), e.g. EEG spellers, which have a low communication rate. Recent research has progressed towards neural speech decoding paradigms that have the potential for normal communication rates. Yet, current neural decoding research is limited to typical speakers and the extent to which these studies can be translated to a target population (e.g., ALS) is still unexplored. Here, we investigated the decoding of imagined and spoken phrases from non-invasive magnetoencephalography (MEG) signals of ALS subjects using several spectral features (band-power of brainwaves: delta, theta, alpha, beta, and gamma frequencies) with seven machine learning decoders (Naive Bayes, K-nearest neighbor, decision tree, ensemble, support vector machine, linear discriminant analysis, and artificial neural network). Experimental results indicated that the decoding performance for ALS patients is lower than healthy subjects yet significantly higher than chance level. The best performances were 75% for decoding five imagined phrases and 88% for five spoken phrases from ALS patients. To our knowledge, this is the first demonstration of neural speech decoding for a speech disordered population.


 DOI: 10.21437/Interspeech.2020-3071

Cite as: Dash, D., Ferrari, P., Hernandez, A., Heitzman, D., Austin, S.G., Wang, J. (2020) Neural Speech Decoding for Amyotrophic Lateral Sclerosis. Proc. Interspeech 2020, 2782-2786, DOI: 10.21437/Interspeech.2020-3071.


@inproceedings{Dash2020,
  author={Debadatta Dash and Paul Ferrari and Angel Hernandez and Daragh Heitzman and Sara G. Austin and Jun Wang},
  title={{Neural Speech Decoding for Amyotrophic Lateral Sclerosis}},
  year=2020,
  booktitle={Proc. Interspeech 2020},
  pages={2782--2786},
  doi={10.21437/Interspeech.2020-3071},
  url={http://dx.doi.org/10.21437/Interspeech.2020-3071}
}