Speech Prosody 2006

Dresden, Germany
May 2-5, 2006

A Trial of Communicative Prosody Generation based on Control Characteristic of One-Word Utterance Observed in Real Conversational Speech

Yoko Greenberg (1), Nagisa Shibuya (1), Minoru Tsuzaki (2), Hiroaki Kato (3), Yoshinori Sagisaka (1)

(1) GITS, Waseda University, Tokyo, Japan
(2) Kyoko City University of Arts, Nishikyo-ku, Kyoto, Japan
(3) ATR Human Information Science Labs, Soraku-gun, Kyoto, Japan

Aiming at prosody control for conversational speech synthesis, communicative prosodies were generated based on the prosodic characteristics derived from one word utterance "n". The grouping of F0 patterns using VQ revealed four F0 dynamic patterns (rise, gradual fall, fall, and rise&fall) for large amounts of one-word utterance "n" in daily conversations. Through the analysis using an F0 generation model, different control characteristics were found for these patterns. A communicative prosody control scheme is proposed for short utterances reflecting these control characteristics for three dimensional representative perceptual impressions, confident-doubtful, allowable-unacceptable and positive-negative previously obtained by MDS analysis. The naturalness evaluation tests for synthesized conversational speech showed superiority in naturalness of the proposed prosody control. These results indicate the possibility of communicative prosody generation for conversational speech synthesis through perceptional impression expressions using corpus-based approach.

Full Paper

Bibliographic reference.  Greenberg, Yoko / Shibuya, Nagisa / Tsuzaki, Minoru / Kato, Hiroaki / Sagisaka, Yoshinori (2006): "A trial of communicative prosody generation based on control characteristic of one-word utterance observed in real conversational speech", In SP-2006, paper 037.