4th International Conference on Spoken Language Processing

Philadelphia, PA, USA
October 3-6, 1996

Multimodal Discourse Modelling in a Multi-user Multi-domain Environment

Stephanie Seneff, David Goddeau, Christine Pao, Joseph Polifroni

Spoken Language Systems Group, Laboratory for Computer Science, Massachusetts Institute of Technology, Cambridge, MA, USA

This paper describes the discourse component of GALAXY, a multidomain, multimodal conversational system. In designing this module, we are attempting to develop domain-independent mechanisms, controlled via declarative tables, to promote convenient instantiation of a discourse component for each new domain. Direct anaphoric reference as well as elliptical reference are dealt with appropriately. Users can also refer verbally to items selected via mouse clicks. Cross domain references are particularly challenging, as is the ambiguity problem arising from different case roles for different subdomains. Users often utter fragments, sometimes in response to serverinitiated dialogue exchanges, so an extensive fragment interpretation mechanism is supported.

Full Paper

Bibliographic reference.  Seneff, Stephanie / Goddeau, David / Pao, Christine / Polifroni, Joseph (1996): "Multimodal discourse modelling in a multi-user multi-domain environment", In ICSLP-1996, 192-195.