Using fNIRS to Characterize Human Perception of TTS System Quality, Comprehension, and Fluency: Preliminary Findings

Rishabh Gupta, Khalil Rehman Laghari, Sebastian Arndt, Robert Schleicher, Sebastian Möller, Douglas O'Shaughnessy, Tiago Falk


The quality of synthesized speech signals from different Text-to-Speech (TTS) systems is traditionally evaluated using subjective tests based on user ratings. Subjective testing, however, is challenging due to the variability and complexity of human perception. As such, recently there has been a shift towards exploring new objective techniques to evaluate the quality of TTS systems. In this paper, we describe our initial effort of characterizing human TTS quality perception via neurophysiological insights obtained from a neuroimaging technology called functional Near Infrared Spectroscopy (fNIRS). This approach allowed for a link between the human decision making process and the quality of different TTS systems to be established. We showed significant correlations between perceived quality and several fNIRS features related to cerebral haemodynamics. These preliminary results have helped establish the potential of fNIRS as an important tool for evaluating the quality of TTS systems.


 DOI: 10.21437/PQS.2013-13

Cite as: Gupta, R., Laghari, K.R., Arndt, S., Schleicher, R., Möller, S., O'Shaughnessy, D., Falk, T. (2013) Using fNIRS to Characterize Human Perception of TTS System Quality, Comprehension, and Fluency: Preliminary Findings. Proc. 4th International Workshop on Perceptual Quality of Systems (PQS 2013), 63-68, DOI: 10.21437/PQS.2013-13.


@inproceedings{Gupta2013,
  author={Rishabh Gupta and Khalil Rehman Laghari and Sebastian Arndt and Robert Schleicher and Sebastian Möller and Douglas O'Shaughnessy and Tiago Falk},
  title={Using fNIRS to Characterize Human Perception of TTS System Quality, Comprehension, and Fluency: Preliminary Findings},
  year=2013,
  booktitle={Proc. 4th International Workshop on Perceptual Quality of Systems (PQS 2013)},
  pages={63--68},
  doi={10.21437/PQS.2013-13},
  url={http://dx.doi.org/10.21437/PQS.2013-13}
}