14thAnnual Conference of the International Speech Communication Association

Lyon, France
August 25-29, 2013

Affective Evaluation of Multimodal Dialogue Games for Preschoolers Using Physiological Signals

Vassiliki Kouloumenta, Manolis Perakakis, Alexandros Potamianos

Technical University of Crete, Greece

In this pilot study, we investigate the differences in the electroencephalography (EEG) signal patterns of children and adults while interacting with a multimodal dialogue computer game. The gaming application is designed for preschoolers, implements five popular learning tasks and has variable levels of difficulty. In this pilot, to simplify the data collection process for young children, we use the NeuroSky MindSet device which is a single forehead dry sensor device. The raw signals and the estimated attention, meditation and arousal signals are analyzed during the interaction and compared for adult and children user populations. Results show consistent variations as a function of modality used (speech vs mouse input), difficulty level and task success. The physiological signal pattern within an interaction turn is also estimated and analyzed. Overall, children and adults demonstrated very similar physiological signal patterns during multimodal interaction.

Full Paper

Bibliographic reference.  Kouloumenta, Vassiliki / Perakakis, Manolis / Potamianos, Alexandros (2013): "Affective evaluation of multimodal dialogue games for preschoolers using physiological signals", In INTERSPEECH-2013, 2415-2419.