Analysis of relations between hand gestures and dialogue act categories

Carlos Ishi, Ryusuke Mikata, Hiroshi Ishiguro


Hand gestures commonly occur in daily dialogue interactions, and have important functions in communication. In this study, we analyzed a multimodal database of three-party conversations, and investigated the relations between the occurrence of hand gestures and speech, with special focus on dialogue act categories. Analysis results revealed that hand gestures occur with highest frequency in turn-keeping phrases, and seldom occur in backchannel-type utterances. On the other hand, self-touch hand motions (adapters) occur more often in backchannel utterances and in laughter intervals, in comparison to other dialogue act categories.


 DOI: 10.21437/SpeechProsody.2018-96

Cite as: Ishi, C., Mikata, R., Ishiguro, H. (2018) Analysis of relations between hand gestures and dialogue act categories. Proc. 9th International Conference on Speech Prosody 2018, 473-477, DOI: 10.21437/SpeechProsody.2018-96.


@inproceedings{Ishi2018,
  author={Carlos Ishi and Ryusuke Mikata and Hiroshi Ishiguro},
  title={Analysis of relations between hand gestures and dialogue act categories},
  year=2018,
  booktitle={Proc. 9th International Conference on Speech Prosody 2018},
  pages={473--477},
  doi={10.21437/SpeechProsody.2018-96},
  url={http://dx.doi.org/10.21437/SpeechProsody.2018-96}
}