Auditory-Visual Speech Processing (AVSP) 2009

University of East Anglia, Norwich, UK
September 10-13, 2009

Aging Effect on Audio-Visual Speech Asynchrony Perception: Comparison of Time-Expanded Speech and a Moving Image of a Talkerís Face

Shuichi Sakamoto (1), Akihiro Tanaka (2), Shun Numahata (1), Atsushi Imai (3), Tohru Takagi (3), YŰiti Suzuki (1)

(1) Research Institute of Electrical Communication and Graduate School of Information Sciences, Tohoku University, Sendai, Japan
(2) Graduate School of Humanities and Sociology, The University of Tokyo, Tokyo, Japan
(3) NHK Science and Technical Research Laboratories, Tokyo, Japan

In this study, we measured detection and tolerance thresholds of auditory-visual asynchrony between time-expanded speech and a moving image of the talkerís face for older adults. During experiments, words were presented under two conditions: asynchrony by time-expanded speech (expansion condition, EXP) and simple timing shift (asynchronous condition, ASYN). We used 16 Japanese shorter words (four morae) and 20 Japanese longer words (seven or eight morae). For EXP, auditory speech signals were expanded and combined with the visual signals so that the onset of the utterance was synchronous. For ASYN, the auditory speech signal was simply lagged behind the visual speech signal. Detection and tolerance thresholds for auditory-visual asynchrony obtained for older adults was higher than these obtained for younger adults, which suggests that older adults are tolerant of audio-visual asynchrony.

Index Terms: lip-reading, auditory-visual asynchrony, timeexpanded speech, detection and tolerance thresholds, aging

Full Paper

Bibliographic reference.  Sakamoto, Shuichi / Tanaka, Akihiro / Numahata, Shun / Imai, Atsushi / Takagi, Tohru / Suzuki, YŰiti (2009): "Aging effect on audio-visual speech asynchrony perception: comparison of time-expanded speech and a moving image of a talker≤s face", In AVSP-2009, 9-12.