Speech Prosody 2010

Chicago, IL, USA
May 10-14, 2010

Cross-Cultural Perception of Vietnamese Audio-Visual Prosodic Attitudes

Dang-Khoa Mac (1,2), Véronique Aubergé (1), Albert Rilliard (3), Eric Castelli (1,2)

(1) Laboratory of Informatics of Grenoble (LIG), CNRS, France
(2) International Research Center MICA, Vietnam; (3) LIMSI-CNRS, Orsay, France

Prosodic attitudes (social affects) are highly linked to the language through the culture, and are a main part of face to face interaction. Therefore, for description and modeling, as well as for applications like translation, language learning or synthesis, a cross-cultural approach is relevant. This paper presents a cross-perception of Audio-Visual prosodic attitudes in Vietnamese, an under-resourced tonal language. Based on an audio-visual corpus of 16 attitudes, perception experiments were carried out with Vietnamese and French participants: firstly, to understand the contribution of audio and visual modalities to affective communication; secondly, to perceptually measure how the native and non-native listeners recognize and confuse the Vietnamese attitudes. The results reveal cultural specificities and cross-cultural common attitudes in Vietnamese. Index Terms: Audio-visual corpus, Prosodic social affects, Cross-cultural perception, Vietnamese

Full Paper

Bibliographic reference.  Mac, Dang-Khoa / Aubergé, Véronique / Rilliard, Albert / Castelli, Eric (2010): "Cross-cultural perception of Vietnamese audio-visual prosodic attitudes", In SP-2010, paper 356.