2nd International Workshop on Speech, Language and Audio in Multimedia (SLAM2014)

Penang, Malaysia
September 11-12, 2014

Investigating Domain-Independent Nlp Techniques for Precise Target Selection in Video Hyperlinking

Anca Simon (1), Camille Guinaudeau (2), Pascale Sébillot (1), Guillaume Gravier (1)

(1) IRISA & Inria Rennes—CNRS, Univ. Rennes 1, INSA Rennes, France
(2) LIMSI-CNRS, Orsay, France

Automatic generation of hyperlinks in multimedia video data is a subject with growing interest, as demonstrated by recent work undergone in the framework of the Search and Hyperlinking task within the Mediaeval benchmark initiative. In this paper, we compare NLP-based strategies for precise target selection in video hyperlinking exploiting speech material, with the goal of providing hyperlinks from a specified anchor to help information retrieval. We experimentally compare two approaches enabling to select short portions of videos which are relevant and possibly complementary with respect to the anchor. The first approach exploits a bipartite graph relating utterances and words to find the most relevant utterances. The second one uses explicit topic segmentation, whether hierarchical or not, to select the target segments. Experimental results are reported on the Mediaeval 2013 Search and Hyperlinking dataset which consists of BBC videos, demonstrating the interest of hierarchical topic segmentation for precise target selection.

Index Terms: Multimedia hyperlinking, topic segmentation, link analysis, information retrieval

Full Paper

Bibliographic reference.  Simon, Anca / Guinaudeau, Camille / Sébillot, Pascale / Gravier, Guillaume (2014): "Investigating domain-independent nlp techniques for precise target selection in video hyperlinking", In SLAM-2014, 19-23.