13th Annual Conference of the International Speech Communication Association

Portland, OR, USA
September 9-13, 2012

Novel Approach to Live Captioning Through Re-Speaking: Tailoring Speech Recognition to Re-Speaker's Needs

Aleš Pražák (1), Zdeněk Loose(2), Jan Trmal (2), Josef V. Psutka (2), Josef Psutka (1,2)

(1) NTIS, University of West Bohemia, Plzeń, Czech Republic
(2) Department of Cybernetics, University of West Bohemia, Plzeń, Czech Republic

A novel approach to the live captioning through re-speaking is introduced in this paper. We describe our concept of re-speaking using only one respeaker with enhanced re-speaker tasks fully integrated to the recognition system and captioning software. New techniques for instant correction of recognition output, punctuation mark introduction or new word addition are presented. Our real-time recognition system of the Czech language with a vocabulary containing more than one million words is described and an architecture of captioning system that we operate is illustrated. Last part of the paper is dedicated to the re-speaker training methodology and a three-level evaluation method of final re-speaker's skills is proposed.

Index Terms: live captioning, speech recognition, re-speaking

Full Paper

Bibliographic reference.  Pražák, Aleš / Loos, Zdeněk / Trmal, Jan / Psutka, Josef V. / Psutka, Josef (2012): "Novel approach to live captioning through re-speaking: tailoring speech recognition to re-speaker's needs", In INTERSPEECH-2012, 1372-1375.