Investigating the Visual Lombard Effect with Gabor Based Features

Waito Chiu, Yan Xu, Andrew Abel, Chun Lin, Zhengzheng Tu

The Lombard Effect shows that speakers increase their vocal effort in the presence of noise, and research into acoustic speech, has demonstrated varying effects, depending on the noise level and speaker, with several differences, including timing and vocal effort. Research also identified several differences, including between gender, and noise type. However, most research has focused on the audio domain, with very limited focus on the visual effect. This paper presents a detailed study of the visual Lombard Effect, using a pilot Lombard Speech corpus developed for our needs, and a recently developed Gabor based lip feature extraction approach. Using Kernel Density Estimation, we identify clear differences between genders, and also show that speakers handle different noise types differently.

 DOI: 10.21437/Interspeech.2020-1291

Cite as: Chiu, W., Xu, Y., Abel, A., Lin, C., Tu, Z. (2020) Investigating the Visual Lombard Effect with Gabor Based Features. Proc. Interspeech 2020, 4606-4610, DOI: 10.21437/Interspeech.2020-1291.

  author={Waito Chiu and Yan Xu and Andrew Abel and Chun Lin and Zhengzheng Tu},
  title={{Investigating the Visual Lombard Effect with Gabor Based Features}},
  booktitle={Proc. Interspeech 2020},