Computer-Assisted Language Learning System: Automatic Speech Evaluation for Children Learning Malay and Tamil

Ke Shi, Kye Min Tan, Richeng Duan, Siti Umairah Md. Salleh, Nur Farah Ain Suhaimi, Rajan Vellu, Ngoc Thuy Huong Helen Thai, Nancy F. Chen


We present a computer-assisted language learning system that automatically evaluates the pronunciation and fluency of spoken Malay and Tamil. Our system consists of a server and a user-facing Android application, where the server is responsible for speech-to-text alignment as well as pronunciation and fluency scoring. We describe our system architecture and discuss the technical challenges associated with low resource languages. To the best of our knowledge, this work is the first pronunciation and fluency scoring system for Malay and Tamil.


Cite as: Shi, K., Tan, K.M., Duan, R., Salleh, S.U.M., Suhaimi, N.F.A., Vellu, R., Thai, N.T.H.H., Chen, N.F. (2020) Computer-Assisted Language Learning System: Automatic Speech Evaluation for Children Learning Malay and Tamil. Proc. Interspeech 2020, 1019-1020.


@inproceedings{Shi2020,
  author={Ke Shi and Kye Min Tan and Richeng Duan and Siti Umairah Md. Salleh and Nur Farah Ain Suhaimi and Rajan Vellu and Ngoc Thuy Huong Helen Thai and Nancy F. Chen},
  title={{Computer-Assisted Language Learning System: Automatic Speech Evaluation for Children Learning Malay and Tamil}},
  year=2020,
  booktitle={Proc. Interspeech 2020},
  pages={1019--1020}
}