5th European Conference on Speech Communication and Technology

Rhodes, Greece
September 22-25, 1997

Evaluating Competing Agent Strategies for a Voice Email Agent

Marilyn Walker, Donald Hindle, Jeanne Fromer, Giuseppe Di Fabbrizio, Craig Mestel

AT&T Labs - Research, Florham Park, NJ, USA

This paper reports experimental results comparing a mixed-initiative to a system-initiative dialog strategy in the context of a personal voice email agent. To independently test the effects of dialog strategy and user expertise, users interact with either the system-initiative or the mixed-initiative agent to perform three successive tasks which are identical for both agents. We report performance comparisons across agent strategies as well as over tasks. This evaluation utilizes and tests the PARADISE evaluation framework, and discusses the performance function derivable from the experimental data.

Full Paper

Bibliographic reference.  Walker, Marilyn / Hindle, Donald / Fromer, Jeanne / Fabbrizio, Giuseppe Di / Mestel, Craig (1997): "Evaluating competing agent strategies for a voice email agent", In EUROSPEECH-1997, 2219-2222.