4th International Conference on Spoken Language Processing

Philadelphia, PA, USA
October 3-6, 1996

Spoken Language Generation in a Multimedia System

Shimei Pan, Kathleen R. McKeown

Columbia University, Department of Computer Science, New York, NY, USA

In this paper we address two important issues in generating spoken language within a multimedia system: the design of a speech generator to facilitate coordination between media, and extensions to the functionality of a written language generation system to produce natural speech output. We demonstrate how a speech generator can produce information that allows for temporal coordination between multiple media. We describe how our speech generator takes advantage of rich and accurate syntactic and semantic information during text planning and speech realization. This enables the system to accurately predict, generate, and utilize prosodic features to facilitate coordination of speech with graphical actions such as highlighting.

Full Paper

Bibliographic reference.  Pan, Shimei / McKeown, Kathleen R. (1996): "Spoken language generation in a multimedia system", In ICSLP-1996, 374-377.