You look blocky, is everything alright? Influence of video distortions on facial expression recognition & quality

Yohann Pitrey, Helmut Hlavacs


The ability to read expressions on human faces is hardwired in the human brain, as a very powerful tool to sample non-verbal information about the emotional disposition of other people. Nowadays, more and more face-toface interactions are happening over multimedia systems, including video conferencing, watching movies and interacting with virtual characters. Some of these systems usually rely on compression and other data reduction mechanisms to cope with limited transmission speeds. This paper evaluates the impact of typical video distortions, such as compression, spatial and temporal downscaling, on the ability of human subjects to recognize facial expressions. We use a realistic face simulator to generate four basic facial expressions, which we distort under typical scenarios, and measure both the ability of participants to recognize the facial expressions and the overall perceived quality. Our results show that the scene composition and the expressions have a significant impact on perception, and show some evidence on the relation between recognition rate and perceived quality.


 DOI: 10.21437/PQS.2013-11

Cite as: Pitrey, Y., Hlavacs, H. (2013) You look blocky, is everything alright? Influence of video distortions on facial expression recognition & quality. Proc. 4th International Workshop on Perceptual Quality of Systems (PQS 2013), 51-56, DOI: 10.21437/PQS.2013-11.


@inproceedings{Pitrey2013,
  author={Yohann Pitrey and Helmut Hlavacs},
  title={You look blocky, is everything alright? Influence of video distortions on facial expression recognition & quality},
  year=2013,
  booktitle={Proc. 4th International Workshop on Perceptual Quality of Systems (PQS 2013)},
  pages={51--56},
  doi={10.21437/PQS.2013-11},
  url={http://dx.doi.org/10.21437/PQS.2013-11}
}