EUROSPEECH 2001 Scandinavia
7th European Conference on Speech Communication and Technology

Aalborg, Denmark
September 3-7, 2001


Multimedia Data Collection of In-Car Speech Communication

Nobuo Kawaguchi, Shigeki Matsubara, Kazuya Takeda, Fumitada Itakura

Nagoya University, Japan

This paper reports the details of the collection of the multimedia data such as audio, video and auxiliary information of the vehicle during a spoken dialogue in a moving car. The system specially built in a Data CollectionVehicle (DCV) supports synchronous recording of multi-channel audio data from 16 microphones, 3-channel video data and the vehicle related data. Multimedia data has been collected for three sessions of spoken dialogue in about a 60-minute drive by each of 200 subjects. Data has been collected for two dialogue modes:(1) prompted dialogue between the driver and an accompanying operator and (2) natural dialogue between the driver and a telephone operator for information access over a cellular phone while driving a car. The corpus can be used for analysis of multimedia data in a moving car environment and also for modeling spoken dialogue in scenarios such as information access while driving a car.

Full Paper

Bibliographic reference.  Kawaguchi, Nobuo / Matsubara, Shigeki / Takeda, Kazuya / Itakura, Fumitada (2001): "Multimedia data collection of in-car speech communication", In EUROSPEECH-2001, 2027-2030.