Auditory-Visual Speech Processing (AVSP) 2010

Hakone, Kanagawa, Japan
September 30-October 3, 2010

The McGurk Effect at Various Auditory Signal-to-Noise Ratios in American and Finnish Listeners

Kaisa Tiippana (1,5), Erin Hayes (2), Riikka Möttönen (3), Nina Kraus (4), Mikko Sams (5)

(1) Institute of Behavioural Sciences, University of Helsinki, Finland
(2) Department of Biology, Loyola University Chicago, USA
(3) Department of Experimental Psychology, University of Oxford, UK
(4) Auditory Neuroscience Laboratory, Northwestern University, USA
(5) Department of Biomedical Engineering and Computational Science, Aalto University, Finland

In the McGurk effect, incongruent visual information alters the auditory speech percept. We studied the strength of this effect as a function of auditory signal-to-noise ratio (SNR: -12, -6, 0, +6 dB, and noise-free) in Finnish adults, American adults and American children (8–12 years). The McGurk stimuli were A/p/V/k/ (auditory /apa/ presented with visual /aka/), A/p/V/t/, A/k/V/p/ and A/t/V/p/. As SNR decreased, proportion of responses based on the auditory component decreased and visual influence got stronger. All participants showed this pattern, though in some instances Finns showed weaker visual influence. Overall, the McGurk effect was very similar in these language and age groups.

Index Terms: McGurk effect, noise, language, age

Full Paper

Bibliographic reference.  Tiippana, Kaisa / Hayes, Erin / Möttönen, Riikka / Kraus, Nina / Sams, Mikko (2010): "The Mcgurk effect at various auditory signal-to-noise ratios in american and Finnish listeners", In AVSP-2010, paper P10.