An Early Study on Intelligent Analysis of Speech Under COVID-19: Severity, Sleep Quality, Fatigue, and Anxiety

Jing Han, Kun Qian, Meishu Song, Zijiang Yang, Zhao Ren, Shuo Liu, Juan Liu, Huaiyuan Zheng, Wei Ji, Tomoya Koike, Xiao Li, Zixing Zhang, Yoshiharu Yamamoto, Björn W. Schuller


The COVID-19 outbreak was announced as a global pandemic by the World Health Organisation in March 2020 and has affected a growing number of people in the past few weeks. In this context, advanced artificial intelligence techniques are brought to the fore in responding to fight against and reduce the impact of this global health crisis. In this study, we focus on developing some potential use-cases of intelligent speech analysis for COVID-19 diagnosed patients. In particular, by analysing speech recordings from these patients, we construct audio-only-based models to automatically categorise the health state of patients from four aspects, including the severity of illness, sleep quality, fatigue, and anxiety. For this purpose, two established acoustic feature sets and support vector machines are utilised. Our experiments show that an average accuracy of .69 obtained estimating the severity of illness, which is derived from the number of days in hospitalisation. We hope that this study can foster an extremely fast, low-cost, and convenient way to automatically detect the COVID-19 disease.


 DOI: 10.21437/Interspeech.2020-2223

Cite as: Han, J., Qian, K., Song, M., Yang, Z., Ren, Z., Liu, S., Liu, J., Zheng, H., Ji, W., Koike, T., Li, X., Zhang, Z., Yamamoto, Y., Schuller, B.W. (2020) An Early Study on Intelligent Analysis of Speech Under COVID-19: Severity, Sleep Quality, Fatigue, and Anxiety. Proc. Interspeech 2020, 4946-4950, DOI: 10.21437/Interspeech.2020-2223.


@inproceedings{Han2020,
  author={Jing Han and Kun Qian and Meishu Song and Zijiang Yang and Zhao Ren and Shuo Liu and Juan Liu and Huaiyuan Zheng and Wei Ji and Tomoya Koike and Xiao Li and Zixing Zhang and Yoshiharu Yamamoto and Björn W. Schuller},
  title={{An Early Study on Intelligent Analysis of Speech Under COVID-19: Severity, Sleep Quality, Fatigue, and Anxiety}},
  year=2020,
  booktitle={Proc. Interspeech 2020},
  pages={4946--4950},
  doi={10.21437/Interspeech.2020-2223},
  url={http://dx.doi.org/10.21437/Interspeech.2020-2223}
}