13th Annual Conference of the International Speech Communication Association

Portland, OR, USA
September 9-13, 2012

A Self-Learning Assistive Vocal Interface Based on Vocabulary Learning and Grammar Induction

Jort F. Gemmeke (1), Janneke van de Loo (2), Guy de Pauw (2), Joris Driesen (1), Hugo Van hamme (1), Walter Daelemans (2)

(1) ESAT - PSI Speech Group, KU Leuven, Leuven, Belgium
(2) CLiPS - Computational Linguistics, University of Antwerp, Antwerp, Belgium

This paper introduces research within the ALADIN project, which aims to develop an assistive vocal interface for people with a physical impairment. In contrast to existing approaches, the vocal interface is self-learning which means it can be used with any language, dialect, vocabulary and grammar. The paper describes the overall learning framework, and the two components that will provide vocabulary learning and grammar induction. In addition, the paper describes encouraging results of early implementations of these vocabulary and grammar learning components, applied to recorded sessions of a vocally guided card game, patience.

Index Terms: language acquisition, word finding, grammar induction, non-negative matrix factorization, concept tagging

Full Paper

Bibliographic reference.  Gemmeke, Jort F. / Loo, Janneke van de / Pauw, Guy de / Driesen, Joris / Van hamme, Hugo / Daelemans, Walter (2012): "A self-learning assistive vocal interface based on vocabulary learning and grammar induction", In INTERSPEECH-2012, 831-834.