Characterization of Audiovisual Dramatic Attitudes

Adela Barbulescu, Rémi Ronfard, Gérard Bailly

In this work we explore the capability of audiovisual parameters (such as fundamental frequency, rhythm, head motion or facial expressions) to discriminate among different dramatic attitudes. We extract the audiovisual parameters from an acted corpus of attitudes and structure them as frame, syllable, and sentence-level features. Using Linear Discriminant Analysis classifiers, we show that sentence-level features present a higher discriminating rate among the attitudes. We also compare the classification results with the perceptual evaluation tests, showing that F0 is correlated to the perceptual results for all attitudes, while other features, such as head motion, contribute differently, depending both on the attitude and the speaker.

DOI: 10.21437/Interspeech.2016-75

Cite as

Barbulescu, A., Ronfard, R., Bailly, G. (2016) Characterization of Audiovisual Dramatic Attitudes. Proc. Interspeech 2016, 585-589.

author={Adela Barbulescu and Rémi Ronfard and Gérard Bailly},
title={Characterization of Audiovisual Dramatic Attitudes},
booktitle={Interspeech 2016},