Predicting Collaborative Task Performance Using Graph Interlocutor Acoustic Network in Small Group Interaction

Shun-Chang Zhong, Bo-Hao Su, Wei Huang, Yi-Ching Liu, Chi-Chun Lee


Recent works have demonstrated that the integration of group-level personality and vocal behaviors can provide enhanced prediction power on task performance for small group interactions. In this work, we propose that the impact of member personality for task performance prediction in groups should be explicitly modeled from both intra and inter-group perspectives. Specifically, we propose a Graph Interlocutor Acoustic Network (G-IAN) architecture that jointly learns the relationship between vocal behaviors and personality attributes with intra-group attention and inter-group graph convolutional layer. We evaluate our proposed G-IAN on two group interaction databases and achieve 78.4% and 72.2% group performance classification accuracy, which outperforms the baseline model that models vocal behavior only by 14% absolute. Further, our analysis shows that Agreeableness and Conscientiousness demonstrate a clear positive impact in our model that leverages the inter-group personality structure for enhanced task performance prediction.


 DOI: 10.21437/Interspeech.2020-1698

Cite as: Zhong, S., Su, B., Huang, W., Liu, Y., Lee, C. (2020) Predicting Collaborative Task Performance Using Graph Interlocutor Acoustic Network in Small Group Interaction. Proc. Interspeech 2020, 3122-3126, DOI: 10.21437/Interspeech.2020-1698.


@inproceedings{Zhong2020,
  author={Shun-Chang Zhong and Bo-Hao Su and Wei Huang and Yi-Ching Liu and Chi-Chun Lee},
  title={{Predicting Collaborative Task Performance Using Graph Interlocutor Acoustic Network in Small Group Interaction}},
  year=2020,
  booktitle={Proc. Interspeech 2020},
  pages={3122--3126},
  doi={10.21437/Interspeech.2020-1698},
  url={http://dx.doi.org/10.21437/Interspeech.2020-1698}
}