Ninth International Conference on Spoken Language Processing

Pittsburgh, PA, USA
September 17-21, 2006

Comparison of the ITU-T P.85 Standard to Other Methods for the Evaluation of Text-to-Speech Systems

Dmitry Sityaev, Katherine Knill, Tina Burrows

Toshiba Research Europe Ltd., UK

Evaluation of TTS systems is essential to assess performance. The ITUT P.85 standard was introduced in 1994 to assess the overall quality of speech synthesis systems. However it has not been widely accepted or used. This paper compares the ITU test to more commonly used tests for intelligibility (semantically unpredictable sentences (SUS)) and naturalness (mean opinion score based). The aim of this research was to determine if the ITU test can provide a better performance measure and/or supplementary information to help evaluate TTS systems.

Full Paper

Bibliographic reference.  Sityaev, Dmitry / Knill, Katherine / Burrows, Tina (2006): "Comparison of the ITU-t p.85 standard to other methods for the evaluation of text-to-speech systems", In INTERSPEECH-2006, paper 1233-Tue2WeO.3.