EUROSPEECH 2001 Scandinavia
In this paper we outline a multimodal interaction description language XISL (Extensible Interaction-Sheet Language) that is developed to describe multimodal interactions (MMI), and to separate the description of interactions from XML contents. XISL makes an XML document independent of interactions that may differ between each terminal, and so enables such seamless services as web-browsing to be constructed easily. Since XISL also provides various combinatorial usage of modalities, a developer can describe a MMI scenario easily. We implemented an interpreter of XISL on prototype systems for multimedia lectures with different types of MMI and proved the viability of XISL by experiments using the systems.
Bibliographic reference. Nitta, Tsuneo / Katsurada, Kouichi / Yamada, Hirobumi / Nakamura, Yusaku / Kobayashi, Satoshi (2001): "XISL: an attempt to separate multimodal interactions from XML contents", In EUROSPEECH-2001, 1197-1200.