13th Annual Conference of the International Speech Communication Association

Portland, OR, USA
September 9-13, 2012

Effects of the Availability of Visual Information and Presence of Competing Conversations on Speech Production

Vincent Aubanel (1,2), Martin Cooke (1,2), Emma Foster (3), Maria Luisa Garcia Lecumberri (1), Catherine Mayo (4)

(1) Language and Speech Laboratory, University of the Basque Country, Vitoria, Spain
(2) Ikerbasque (Basque Foundation for Science), Spain
(3) Department of Human Communication Sciences, University of Sheffield, UK
(4) Centre for Speech Technology Research, University of Edinburgh, UK

How do talkers maintain intelligibility when speaking in the presence of a background conversation? The current study identified acoustic and temporal modifications of speech manifested by interlocutors in the face of competing speech, with and without visual contact. Pairs of talkers held free conversations either alone or in the presence of a second pair. Regardless of the availability of visual information, speaking simultaneously with another talker resulted in overall increases in energy, F0, F1 and a decrease in speech rate. Overlapping with the background pair resulted in an increase in energy but no change in the two prosodic parameters F0 and speech rate. By contrast, within-pair overlap led to an increase in F0 and a decrease in rate, and no change in speech level. The absence of visual cues produced a significant reduction in withinpair overlap, which tended to be greater when the background pair was present. These findings emphasize the need to distinguish between Lombard and interactional influences on acoustic parameters, and suggest that adverse conditions such as competing speech or absence of visual cues cause interlocutors to adopt more careful dialogue strategies, perhaps with the aim of reducing energetic and informational masking at the ears of the listener.

Index Terms: simultaneous conversations, speech production modifications, speech in noise

Full Paper

Bibliographic reference.  Aubanel, Vincent / Cooke, Martin / Foster, Emma / Garcia Lecumberri, Maria Luisa / Mayo, Catherine (2012): "Effects of the availability of visual information and presence of competing conversations on speech production", In INTERSPEECH-2012, 2033-2036.