ESCA Workshop on Audio-Visual Speech Processing (AVSP'97)

September 26-27, 1997
Rhodes, Greece

Audiovisual Fusion in Finnish Syllables and Words

M. Sams, V. Surakka, P. Helin, R. Kättö

Department of Psychology, University of Tampere, Tampere, Finland

We studied the audiovisual fusion (acoustical /p/, visual /k/) in native Finnish speakers for Finnish 1) syllables, 2) words, and 3) words in sentences. 90%-97% of the identifications were biased by visual stimulation. The McGurk effect was very similar for the various stimulus types. The nature of the fusion was not dependent on the meaningfulness of the stimuli. Due to the fusion, acoustically proper words were perceived as non-words. The results demonstrate a strong McGurk effect for native Finnish speakers and support the idea that the audiovisual integration occurs at a relative early but language-specific stage.

Full Paper

Bibliographic reference.  Sams, M. / Surakka, V. / Helin, P. / Kättö, R. (1997): "Audiovisual fusion in finnish syllables and words", In AVSP-1997, 101-104.