Fourth European Conference on Speech Communication and Technology

Madrid, Spain
September 18-21, 1995

McGurk Effect in Spanish and German Listeners: Influences of Visual Cues in the Perception of Spanish and German Conflicting Audio-Visual Stimuli

Angela Fuster Duran

Institute of Phonetics, Cologne, Germany

A corpus of discrepant AV German and Spanish syllables was created in order to examine how audio-visual integration functions in those languages and to investigate possible interlanguage differences in the magnitude and type of visual effects. 15 syllables /ba, ma, da, na, ga, Na, la, ra, rra, bra, dra, gra, bla, dla, gla/ were produced by one German speaker and one Spanish speaker. Both sets of syllables were audiovisually recorded and combined^ with , , and video sequences resulting in 45 AV-stimuli. German AV-stimuli were presented to 30 German and 30 Spanish subjects; Spanish AV- stimuli to 30 German and 30, Spanish subjects. Subjects were asked to report what they perceived. Results showed perceptual differences across the 4 conditions. The influence of visual cues was stronger with the Spanish speaker than with the German one. Germans showed a higher amount of visual effects in the non-native language. Keywords: Bimodal Speech Perception, Audio-visual integration, McGurk effect, Interlanguage difference.

Full Paper

Bibliographic reference.  Fuster Duran, Angela (1995): "Mcgurk effect in Spanish and German listeners: influences of visual cues in the perception of Spanish and German conflicting audio-visual stimuli", In EUROSPEECH-1995, 295-298.