Auditory-Visual Speech Processing (AVSP) 2010

Hakone, Kanagawa, Japan
September 30-October 3, 2010

Binding and Unbinding in Audiovisual Speech Fusion: Removing the McGurk Effect by an Incoherent Preceding Audiovisual Context

Olha Nahorna, Frédéric Berthommier, Jean-Luc Schwartz

GIPSA-Lab, UMR CNRS 5216 – Grenoble University, France

The McGurk effect demonstrates the existence of a fusion process in audiovisual speech perception. We consider here the assumption that fusion is controlled by an upstream conditional binding process, which can block fusion in the case of strong audiovisual inconsistencies, as in the case of a dubbed film. To test this hypothesis, we designed two experiments in which a consistent or inconsistent audiovisual context is placed before McGurk stimuli, and we show that inconsistent contexts can remove the McGurk effect.. Keywords: McGurk effect, binding, multisensory fusion, AV speech perception and scene analysis.

Full Paper

Bibliographic reference.  Nahorna, Olha / Berthommier, Frédéric / Schwartz, Jean-Luc (2010): "Binding and unbinding in audiovisual speech fusion: removing the Mcgurk effect by an incoherent preceding audiovisual context", In AVSP-2010, paper P11.