13th Annual Conference of the International Speech Communication Association

Portland, OR, USA
September 9-13, 2012

Classifying Skewed Data: Importance Weighting to Optimize Average Recall

Andrew Rosenberg

Department of Computer Science, Queens College (CUNY), Flushing, NY, USA

Promoted in part by its use in the Interspeech Challenges in 2009-2012, Average Recall has emerged as an attractive evaluation measure of classifier performance where the data has a skewed class distribution. In this paper, we show that importance weighting can be used to directly optimize Average Recall. We compare this approach to sampling techniques that have been previously used to classify skewed data. We demonstrate the use of this approach on the Interspeech 2009 Emotion Challenge tasks, and prosodic analysis tasks.

Index Terms: skewed class distributions, prosody, prosodic analysis, emotion classification.

Full Paper

Bibliographic reference.  Rosenberg, Andrew (2012): "Classifying skewed data: importance weighting to optimize average recall", In INTERSPEECH-2012, 2242-2245.