Auditory-Visual Speech Processing (AVSP) 2010

Hakone, Kanagawa, Japan
September 30-October 3, 2010

Impact of Language on Audiovisual Speech Perception Examined by fMRI

Jun Shinozaki (1), Kaoru Sekiyama (2),Nobuo Hiroe (3), Taku Yoshioka (3), Masa-aki Sato (3)

(1) Department of System Neuroscience, School of Medicine, Sapporo Medical University, JAPAN
(2) Division of Cognitive Psychology, Faculty of Letters, Kumamoto University, Kumamoto, JAPAN
(3) ATR Neural Information Analysis Laboratories, Seika-cho, JAPAN

Both auditory and visual information plays an important role for audiovisual speech perception during face-to-face communication. Several behavioral studies have shown that native English speakers and native Japanese speakers behaved differently in audiovisual speech perception. We hypothesized that there would be differences in neural processing between native English speakers and native Japanese speakers. Twenty-two English language speakers and 22 Japanese speakers watched talker’s face and listened to talker’s speaking during functional magnetic resonance imaging (fMRI) scanning. The lateral occipitotemporal gyrus was associated with visual domain of audiovisual speech perception in native Japanese speakers, but not in native English speakers, suggesting that language environment affects neural processes for audiovisual speech perception.

Index Terms: speech perception, language, fMRI

Full Paper

Bibliographic reference.  Shinozaki, Jun / Sekiyama, Kaoru / Hiroe, obuo / Yoshioka, Taku / Sato, Masa-aki (2010): "Impact of language on audiovisual speech perception examined by fMRI", In AVSP-2010, paper S5-2.