Fourth European Conference on Speech Communication and Technology

Madrid, Spain
September 18-21, 1995

Verbal-Gestural Behaviors in Multimodal Spoken Language Interpreting Telecommunications

Kyung-ho Loken-Kim, Young-duk Park, Suguru Mizunashi, Laurel Fais, Tsyuoshi Morimoto

ATR Interpreting Telecommunications Research Laboratories, Soraku-gun, Kyoto, Japan

The study reported here is an attempt to understand human verbal-gestural behavior in a multimodal bilingual setting. Specific questions addressed are: 1) What kind of deictic gestures people use in a machine-mediated condition, and how these differ from those used in a human-mediated condition, 2) How significant the use of gestures is in each condition, and 3) How verbal and gestural behaviors are interrelated, 4) What the implications of our findings are for a multimodal spoken language interpretation system.

Full Paper

Bibliographic reference.  Loken-Kim, Kyung-ho / Park, Young-duk / Mizunashi, Suguru / Fais, Laurel / Morimoto, Tsyuoshi (1995): "Verbal-gestural behaviors in multimodal spoken language interpreting telecommunications", In EUROSPEECH-1995, 281-284.