ESCA Workshop on Audio-Visual Speech Processing (AVSP'97)
September 26-27, 1997
In audio-visual communication, acoustic and optical modalities are simultaneously at work and their respective signals are intertwined in complex ways. Two kinds of bimodality are distinguished: micro-bimodality and macro-bimodality, the relationship of these optical and acoustic signals with the optical signals performed by hand gestures, facial expression and body movements. Some differences and similarities are described between the two kinds of bimodality on the production and perception side, and a model of context is proposed to account for how acoustic and optical modalities are arranged in the planning and understanding of bimodal communication.
Bibliographic reference. Magno Caldognetto, Emanuela / Poggi, Isabella (1997): "Micro- and macro-bimodality", In AVSP-1997, 33-36.