Odyssey 2012 - The Speaker and Language Recognition Workshop

June 25-28, 2012

The REPERE Challenge: Finding People in a Multimodal Context

Juliette Kahn (1), Olivier Galibert (1), Matthieu Carré (2), Aude Giraudel (3), Philippe Joly (4), Ludovic Quintard (1)

(1) Laboratoire National de métrologie et d'Essais, Trappes, France
(2) ELDA, Paris, France
(3) Direction Générale de l'Armement, Bagneux, France
(4) IRIT, Toulouse, France

The REPERE Challenge aims to support research on people recognition in multimodal conditions. To assess the technology progress, annual evaluation campaigns will be organized from 2012 to 2014. In this context, the REPERE corpus, a French video corpus with multimodal annotation, has been developed. The systems which participated in the dry run had to answer the following questions: Who is speaking? Who is present in the video? What names are cited? What names are displayed? The first results obtained during a dry run show that significant progress are quite possible. The challenge is to combine the various information coming from the speech and the images.

Full Paper

Bibliographic reference.  Kahn, Juliette / Galibert, Olivier / Carré, Matthieu / Giraudel, Aude / Joly, Philippe / Quintard, Ludovic (2012): "The REPERE challenge: finding people in a multimodal context", In Odyssey-2012, 283-290.