First Workshop on Speech, Language and Audio in Multimedia (SLAM 2013)

Marseille, France
August 22-23, 2013

Processing and Linking Audio Events in Large Multimedia Archives: The EU inEvent Project

Hervé Bourlard (1,2), Marc Ferràs (1), Nikolaos Pappas (1,2), Andrei Popescu-Belis (1), Steve Renals (3), Fergus McInnes (3), Peter J. Bell (3), Sandy Ingram (4), Mael Guillemot (4)

(1) Idiap Research Institute, P.O. Box 592, CH-1920 Martigny, Switzerland
(2) Ecole Polytechnique Fédérale, Lausanne, Switzerland
(3) School of Informatics, University of Edinburgh, Edinburgh EH8 9AB, UK
(4) Klewel SA, Martigny, Switzerland

In the inEvent EU project [1], we aim at structuring, retrieving, and sharing large archives of networked, and dynamically changing, multimedia recordings, mainly consisting of meetings, videoconferences, and lectures. More specifically, we are developing an integrated system that performs audiovisual processing of multimedia recordings, and labels them in terms of interconnected “hyper-events” (a notion inspired from hyper-texts). Each hyper-event is composed of simpler facets, including audio-video recordings and metadata, which are then easier to search, retrieve and share. In the present paper, we mainly cover the audio processing aspects of the system, including speech recognition, speaker diarization and linking (across recordings), the use of these features for hyper-event indexing and recommendation, and the search portal. We present initial results for feature extraction from lecture recordings using the TED talks.

Reference

  1. "Accessing dynamic networked multimedia events," in EU Project No. 287872, Network Media. [Online]. Available: https://www.inevent-project.eu/

Index Terms: Networked multimedia events; audio processing: speech recognition; speaker diarization and linking; multimedia indexing and searching; hyper-events.

Full Paper

Bibliographic reference.  Bourlard, Hervé / Ferràs, Marc / Pappas, Nikolaos / Popescu-Belis, Andrei / Renals, Steve / McInnes, Fergus / Bell, Peter J. / Ingram, Sandy / Guillemot, Mael (2013): "Processing and linking audio events in large multimedia archives: the EU inevent project", In SLAM-2013, 3-8.