A Comparison of Acoustic and Linguistics Methodologies for Alzheimer’s Dementia Recognition

Nicholas Cummins, Yilin Pan, Zhao Ren, Julian Fritsch, Venkata Srikanth Nallanthighal, Heidi Christensen, Daniel Blackburn, Björn W. Schuller, Mathew Magimai-Doss, Helmer Strik, Aki Härmä

In the light of the current COVID-19 pandemic, the need for remote digital health assessment tools is greater than ever. This statement is especially pertinent for elderly and vulnerable populations. In this regard, the INTERSPEECH 2020 Alzheimer’s Dementia Recognition through Spontaneous Speech (ADReSS) Challenge offers competitors the opportunity to develop speech and language-based systems for the task of Alzheimer’s Dementia (AD) recognition. The challenge data consists of speech recordings and their transcripts, the work presented herein is an assessment of different contemporary approaches on these modalities. Specifically, we compared a hierarchical neural network with an attention mechanism trained on linguistic features with three acoustic-based systems: (i) Bag-of-Audio-Words (BoAW) quantising different low-level descriptors, (ii) a Siamese Network trained on log-Mel spectrograms, and (iii) a Convolutional Neural Network (CNN) end-to-end system trained on raw waveforms. Key results indicate the strength of the linguistic approach over the acoustics systems. Our strongest test-set result was achieved using a late fusion combination of BoAW, End-to-End CNN, and hierarchical-attention networks, which outperformed the challenge baseline in both the classification and regression tasks.

 DOI: 10.21437/Interspeech.2020-2635

Cite as: Cummins, N., Pan, Y., Ren, Z., Fritsch, J., Nallanthighal, V.S., Christensen, H., Blackburn, D., Schuller, B.W., Magimai-Doss, M., Strik, H., Härmä, A. (2020) A Comparison of Acoustic and Linguistics Methodologies for Alzheimer’s Dementia Recognition. Proc. Interspeech 2020, 2182-2186, DOI: 10.21437/Interspeech.2020-2635.

  author={Nicholas Cummins and Yilin Pan and Zhao Ren and Julian Fritsch and Venkata Srikanth Nallanthighal and Heidi Christensen and Daniel Blackburn and Björn W. Schuller and Mathew Magimai-Doss and Helmer Strik and Aki Härmä},
  title={{A Comparison of Acoustic and Linguistics Methodologies for Alzheimer’s Dementia Recognition}},
  booktitle={Proc. Interspeech 2020},