ISCA Archive Interspeech 2021
ISCA Archive Interspeech 2021

Ensemble-Within-Ensemble Classification for Escalation Prediction from Speech

Oxana Verkholyak, Denis Dresvyanskiy, Anastasia Dvoynikova, Denis Kotov, Elena Ryumina, Alena Velichko, Danila Mamontov, Wolfgang Minker, Alexey Karpov

Conflict situations arise frequently in our daily life and often require timely response to resolve the issues. In order to automatically classify conflict (also referred to as escalation) speech utterances we propose ensemble learning as it improves prediction performance by combining several heterogeneous models that compensate for each other’s weaknesses. However, the effectiveness of the classification ensemble greatly depends on its constituents and their fusion strategy. This paper provides experimental evidence for effectiveness of different prediction-level fusion strategies and demonstrates the performance of each proposed ensemble on the Escalation Sub-Challenge (ESS) in the framework of the Computational Paralinguistics Challenge (ComParE-2021). The ensembles comprise various machine learning approaches based on acoustic and linguistic characteristics of speech. The training strategy is specifically designed to increase the generalization performance on the unseen data, while the diverse nature of ensemble candidates ensures high prediction power and accurate classification.

doi: 10.21437/Interspeech.2021-1821

Cite as: Verkholyak, O., Dresvyanskiy, D., Dvoynikova, A., Kotov, D., Ryumina, E., Velichko, A., Mamontov, D., Minker, W., Karpov, A. (2021) Ensemble-Within-Ensemble Classification for Escalation Prediction from Speech. Proc. Interspeech 2021, 481-485, doi: 10.21437/Interspeech.2021-1821

  author={Oxana Verkholyak and Denis Dresvyanskiy and Anastasia Dvoynikova and Denis Kotov and Elena Ryumina and Alena Velichko and Danila Mamontov and Wolfgang Minker and Alexey Karpov},
  title={{Ensemble-Within-Ensemble Classification for Escalation Prediction from Speech}},
  booktitle={Proc. Interspeech 2021},