ISCA Tutorial and Research Workshop on Experimental Linguistics (ExLing 2008)
For objective evaluation of the second language learners translation proficiency, we tested two measures commonly used in statistical machine translation. One is word n-gram probability of a target language to measure likelihood of translated sentences as a target language. The other one is translation probabilities from source language sentences to target language sentences to measure translation accuracies between these sentences. The subjective proficiency scores of Japanese learners were compared with these objective measures extracted from English sentences translated by them. Statistical analysis showed no correlation of word n-gram probabilities but high correlation of translation probabilities which suggests the usefulness for objective evaluation of learners translation proficiency.
Bibliographic reference. Tsubaki, Hajime / Yasuda, Keiji / Yamamoto, Hirofumi / Sagisaka, Yoshinori (2008): "Objective evaluation of second language learner²s translation proficiency using statistical translation measures", In ExLing-2008, 217-220.