Speech Prosody 2010

Chicago, IL, USA
May 10-14, 2010

Towards the Automated Visualization and Analysis of Signed Language Motion – Method and Linguistic Issues

Tommi Jantunen (1), Markus Koskela (2), Jorma Laaksonen (2), Päivi Rainò (3)

(1) Department of Languages, University of Jyväskylä, Finland
(2) Department of Information and Computer Science, Aalto University School of Science and Technology, Finland
(3) Sign Language Unit, Finnish Association of the Deaf, Finland

This paper presents a semi-automatic method for the visualization and analysis of motion in signed language from a digital video. The method detects the different parts of the signer's bare skin on the video, tracks the motion of the different parts of the body and represents the frame-wise motion of the parts of the body with statistical descriptors. Results of an experiment are demonstrated and discussed. The main linguistic issue deals with the relationship between signs and transitional sequences. Evidence is provided for the claim that lexical-phonological and transitional sequences are qualitatively different in terms of their motion characteristics.

Index Terms: sign language, motion analysis, transitional movement

Full Paper

Bibliographic reference.  Jantunen, Tommi / Koskela, Markus / Laaksonen, Jorma / Rainò, Päivi (2010): "Towards the automated visualization and analysis of signed language motion – method and linguistic issues", In SP-2010, paper 006.