Auditory-Visual Speech Processing (AVSP) 2009

University of East Anglia, Norwich, UK
September 10-13, 2009

Untying the Knot Between Gestures and Speech

Marieke Hoetjes, Emiel Krahmer, Marc Swerts

Communication and Cognition group, Humanities Department, Tilburg University, The Netherlands

Do people speak differently when they cannot use their hands? This study looks at the influence of gestures on speech by having participants take part in an instructional task, half of which had to be performed while sitting on their hands. Other factors that influence the ease of communication, such as visibility and cognitive load, were also taken into account. Results show that lack of visibility or the inability to gesture as well as cognitive load lead to changes in speech and that these factors may influence the successfulness of the instructions.

Index Terms: gesture, visibility, cognitive load, instructional task

Full Paper

Bibliographic reference.  Hoetjes, Marieke / Krahmer, Emiel / Swerts, Marc (2009): "Untying the knot between gestures and speech", In AVSP-2009, 90-95.