The influence of handedness and pointing direction on deictic gestures and speech interaction: Evidence from motion capture data on Polish counting-out rhymes 

Katarzyna Stoltmann, Susanne Fuchs


Does handedness influence pointing gestures? Within the scope of our study, we investigated the influence of handedness, in this case dominant vs. non-dominant hand, on pointing gestures in Polish counting-out rhymes under two conditions: fast and normal speech. For this, pointing gestures of the index finger were recorded with a motion capture system. Speech acoustics was recorded simultaneously. We hypothesized that a detailed analysis of individual gestures would reveal different kinematic patterns for the dominant versus non-dominant hand. Moreover, we expected that pointing towards the addressee would differ from pointing towards the origo (the speaker), since the pointing hand is part of the origo and different muscle synergies are involved. Results of our study revealed shorter duration of pointing gestures and higher peak velocities under time pressure. Higher velocity peaks were also found for pointing with the dominant hand in comparison to the non-dominant hand, in particular while pointing to the addressee. These findings suggest that hand gestures adapt to temporal constraints, and provide first insights that handedness and pointing direction have an impact on kinematic properties of deictic gestures.


 DOI: 10.21437/AVSP.2017-5

Cite as: Stoltmann, K., Fuchs, S. (2017) The influence of handedness and pointing direction on deictic gestures and speech interaction: Evidence from motion capture data on Polish counting-out rhymes . Proc. The 14th International Conference on Auditory-Visual Speech Processing, 21-25, DOI: 10.21437/AVSP.2017-5.


@inproceedings{Stoltmann2017,
  author={Katarzyna Stoltmann and Susanne Fuchs},
  title={ The influence of handedness and pointing direction on deictic gestures and speech interaction: Evidence from motion capture data on Polish counting-out rhymes },
  year=2017,
  booktitle={Proc. The 14th International Conference on Auditory-Visual Speech Processing},
  pages={21--25},
  doi={10.21437/AVSP.2017-5},
  url={http://dx.doi.org/10.21437/AVSP.2017-5}
}