2nd International Workshop on Speech, Language and Audio in Multimedia (SLAM2014)

Penang, Malaysia
September 11-12, 2014

Combining Audio-Visual Features for Viewers’ Perception Classification of Youtube Car Commercials

Fernando Fernández-Martínez, Alejandro Hernández-García, Ascensión Gallardo-Antolín, Fernando Díaz-De-María

Department of Signal Theory and Communications, Universidad Carlos III of Madrid, Leganés, Spain

In this paper, we present a computational model capable of predicting the viewer perception of Youtube car TV commercials by using a set of low-level audio and visual descriptors. Our research goal relies on the hypothesis that these descriptors could reflect to some extent the objective value of the videos and, in turn, the average viewer’s perception. To that end, and as a novel approach to this problem, we automatically annotate our video corpus, grouped into 2 classes corresponding to different satisfaction levels, by means of a regular k-means algorithm applied to the video metadata related to users feedback. Evaluation results show that simple linear logistic regression models based on the 10 best visual descriptors and on the 10 best audio descriptors individually perform reasonably well, achieving a classification accuracy of roughly 70% and 75%, respectively. Combination of audio and visual descriptors yields better performance, roughly 86% for the top-20 selected from the entire descriptor set, but tipping the balance in favor of the audio ones (i.e. 17 vs 3). Audio content bigger influence in this domain is also evidenced by a side analysis of the video comments.

Index Terms: subjective assessment, video aesthetics, Music Information Retrieval, video metadata

Full Paper

Bibliographic reference.  Fernández-Martínez, Fernando / Hernández-García, Alejandro / Gallardo-Antolín, Ascensión / Díaz-De-María, Fernando (2014): "Combining audio-visual features for viewers’ perception classification of Youtube car commercials", In SLAM-2014, 14-18.