An Utterance Verification System for Word Naming Therapy in Aphasia

David S. Barbera, Mark Huckvale, Victoria Fleming, Emily Upton, Henry Coley-Fisher, Ian Shaw, William Latham, Alexander P. Leff, Jenny Crinion


Anomia (word finding difficulties) is the hallmark of aphasia an acquired language disorder, most commonly caused by stroke. Assessment of speech performance using picture naming tasks is therefore a key method for identification of the disorder and monitoring patient’s response to treatment interventions. Currently, this assessment is conducted manually by speech and language therapists (SLT). Surprisingly, despite advancements in ASR and artificial intelligence with technologies like deep learning, research on developing automated systems for this task has been scarce. Here we present an utterance verification system incorporating a deep learning element that classifies ‘correct’/‘incorrect’ naming attempts from aphasic stroke patients. When tested on 8 native British-English speaking aphasics the system’s performance accuracy ranged between 83.6% to 93.6%, with a 10 fold cross validation mean of 89.5%. This performance was not only significantly better than one of the leading commercially available ASRs (Google speech-to-text service) but also comparable in some instances with two independent SLT ratings for the same dataset.


 DOI: 10.21437/Interspeech.2020-2265

Cite as: Barbera, D.S., Huckvale, M., Fleming, V., Upton, E., Coley-Fisher, H., Shaw, I., Latham, W., Leff, A.P., Crinion, J. (2020) An Utterance Verification System for Word Naming Therapy in Aphasia. Proc. Interspeech 2020, 706-710, DOI: 10.21437/Interspeech.2020-2265.


@inproceedings{Barbera2020,
  author={David S. Barbera and Mark Huckvale and Victoria Fleming and Emily Upton and Henry Coley-Fisher and Ian Shaw and William Latham and Alexander P. Leff and Jenny Crinion},
  title={{An Utterance Verification System for Word Naming Therapy in Aphasia}},
  year=2020,
  booktitle={Proc. Interspeech 2020},
  pages={706--710},
  doi={10.21437/Interspeech.2020-2265},
  url={http://dx.doi.org/10.21437/Interspeech.2020-2265}
}