Ninth International Conference on Spoken Language Processing

Pittsburgh, PA, USA
September 17-21, 2006

Summarization Evaluation for Text and Speech: Issues and Approaches

Ani Nenkova

Stanford University, USA

This paper surveys current text and speech summarization evaluation approaches. It discusses advantages and disadvantages of these, with the goal of identifying summarization techniques most suitable to speech summarization. Precision/recall schemes, as well as summary accuracy measures which incorporate weightings based on multiple human decisions, are suggested as particularly suitable in evaluating speech summaries.

Full Paper

Bibliographic reference.  Nenkova, Ani (2006): "Summarization evaluation for text and speech: issues and approaches", In INTERSPEECH-2006, paper 2079-Wed1WeS.1.