Third ESCA/COCOSDA Workshop on Speech Synthesis

November 26-29, 1998
Jenolan Caves House, Blue Mountains, NSW, Australia

Joint Evaluation of Text-To-Speech Synthesis in French Within the AUPELF ARC-B3 Project

Christophe d'Alessandro and the ARC-B3 Team

LIMSI-CNRS, Orsay, France

A joint international evaluations of Text-To-Speech syn- thesis (TTS) systems is being conducted for the French language. This project involves eight laboratories of French-speaking countries (Belgium, Canada, France and Switzerland), and is funded by AUPELF (Association of French Speaking Universities) The results obtained after 2 years of work are presented in this paper. The project is split into 4 tasks: 1/ evaluation of grapheme-to-phoneme conversion; 2/ evaluation of prosody; 3/ evaluation of segments concatenation/modification; 4/ global system evalu- ation. Grapheme-phoneme conversion evaluation has now been completed, and both methodological issues and results for the eight systems are presented at the workshop. For prosody evaluation, the problem is to study several systems that incorporate di erent linguistic analyses, different prosodic systems, di erent intonation and rhythmic models. Using the same phonemic input and the same con- catenation/modification system with the same diphones, it will be possible to assess prosodic quality independently of the other modules. Perceptual evaluation is used at this stage. The degradation introduced by concatenation/modification systems and by the quality of segment data-bases will be studied using perceptual tests. Evaluation of the global systems will also be performed, using both intellegibility and agreement measures. Finally, one of the aims of this project is to make available corpora and evaluation paradigms that may be reused in future research. This will enable a quantitative analysis of the results obtained, and a measurement of the progress achieved for each specific system.


Full Paper

Bibliographic reference.  d'Alessandro, Christophe (1998): "Joint Evaluation of Text-To-Speech Synthesis in French Within the AUPELF ARC-B3 Project", In SSW3-1998, 11-16.