4th International Conference on Spoken Language Processing

Philadelphia, PA, USA
October 3-6, 1996

How Many Words is a Picture Really Worth?

Laurel Fais, Kyung-ho Loken-Kim, Tsuyoshi Morimoto

ATR Interpreting Telecommunications Research Laboratories

Subjects communicating in telephone and multimedia setting do not replace speech with visual images in the multimedia setting. Instead, they use more words in this environment. We discuss the trade-off between words and images, addressing this surprising result. Several factors are involved: use of redundant visual information; "meta-media" conversation; and a slightly greater amount of information conveyed in the multimedia setting. Suggestions concerning integration of a multimedia interface with automatic translation are made.

Full Paper

Bibliographic reference.  Fais, Laurel / Loken-Kim, Kyung-ho / Morimoto, Tsuyoshi (1996): "How many words is a picture really worth?", In ICSLP-1996, 2179-2182.