ISCA Tutorial and Research Workshop on Experimental Linguistics (ExLing 2008)

Athens, Greece
August 25-27, 2008

Objective Evaluation of Second Language Learner’s Translation Proficiency Using Statistical Translation Measures

Hajime Tsubaki (1), Keiji Yasuda (2), Hirofumi Yamamoto (2,3), Yoshinori Sagisaka (1,2)

(1) GITI / Language and Speech Science Research Laboratories, Waseda University
(2) NiCT/ATR, Japan
(3) School of Science and Engineering, Kinki University, Japan

For objective evaluation of the second language learner’s translation proficiency, we tested two measures commonly used in statistical machine translation. One is word n-gram probability of a target language to measure likelihood of translated sentences as a target language. The other one is translation probabilities from source language sentences to target language sentences to measure translation accuracies between these sentences. The subjective proficiency scores of Japanese learners were compared with these objective measures extracted from English sentences translated by them. Statistical analysis showed no correlation of word n-gram probabilities but high correlation of translation probabilities which suggests the usefulness for objective evaluation of learner’s translation proficiency.

Full Paper

Bibliographic reference.  Tsubaki, Hajime / Yasuda, Keiji / Yamamoto, Hirofumi / Sagisaka, Yoshinori (2008): "Objective evaluation of second language learner²s translation proficiency using statistical translation measures", In ExLing-2008, 217-220.