Speech Prosody 2010

Chicago, IL, USA
May 10-14, 2010

Modeling A-Priori Likelihoods for Angry User Turns with Hidden Markov Models

Alexander Schmitt (1), Tim Polzehl (2), Wolfgang Minker (1)

(1) Institute for Information Technology, University of Ulm, Germany
(2) Quality and Usability Lab TU Berlin / Deutsche Telekom Laboratories, Berlin, Germany

Current studies dealing with the detection of angry users in automated telephone-based speech applications take acoustic and sometimes linguistic information into account in order to classify the emotional state of the caller in single user turns. Angry user turns, however, don't appear from nowhere and the likelihood of observing another angry turn rises substantially when anger has already been observed previously in the discourse. In this contribution we examine the context of angry user turns in two different telephone corpora. We then introduce Hidden Markov Models (HMM) as classifiers modeling the temporal aspects of anger across single turns. As additional information source, the HMMs improve our acoustic classifier serving as baseline substantially. Performance gains of 1-4 % can be reported by performing late fusion of the acoustic classifier and the HMMs.

Full Paper

Bibliographic reference.  Schmitt, Alexander / Polzehl, Tim / Minker, Wolfgang (2010): "Modeling a-priori likelihoods for angry user turns with hidden Markov models", In SP-2010, paper 174.