13th Annual Conference of the International Speech Communication Association

Portland, OR, USA
September 9-13, 2012

“Help Me, I Need More User Tests!” User Simulations as Supportive Tool in the Development Process of Spoken Dialogue Systems

Florian Kretzschmar, Sebastian Möller

Quality & Usability Lab, Telekom Innovation Laboratories, TU Berlin, Germany

In this paper we present our experiences in developing a spoken dialogue system supported by tests with a user simulation. Since the code of dialogue systems with modest complexity can easily get unclear, it is almost impossible to deliver error-free systems without user tests in the development process. We show how we included our user simulation environment SpeechEval in the development process of three VoiceXML dialogue systems and discuss advantages and drawbacks compared to tests with real users.

Index Terms: spoken dialogue systems, user simulation, user tests

Full Paper

Bibliographic reference.  Kretzschmar, Florian / Möller, Sebastian (2012): "“help me, i need more user tests!” user simulations as supportive tool in the development process of spoken dialogue systems", In INTERSPEECH-2012, 322-325.