INTERSPEECH 2006 - ICSLP
This paper surveys current text and speech summarization evaluation approaches. It discusses advantages and disadvantages of these, with the goal of identifying summarization techniques most suitable to speech summarization. Precision/recall schemes, as well as summary accuracy measures which incorporate weightings based on multiple human decisions, are suggested as particularly suitable in evaluating speech summaries.
Bibliographic reference. Nenkova, Ani (2006): "Summarization evaluation for text and speech: issues and approaches", In INTERSPEECH-2006, paper 2079-Wed1WeS.1.