12th Annual Conference of the International Speech Communication Association

Florence, Italy
August 27-31. 2011

Using Features from Topic Models to Alleviate Over-Generation in Hierarchical Phrase-Based Translation

Songfang Huang, Bowen Zhou

IBM T.J. Watson Research Center, USA

In hierarchical phrase-based translation systems, the grammars (SCFG rules) have over-generation problem because we can replace the non-terminal X with almost everything without knowing the syntactic or semantic role of X. In this paper, we present an approach that uses topic models to learn the distributions for non-terminals in each SCFG rule, based on which we further derive static features for the discriminative framework of statistical machine translation. Experimental results on three corpora show that we can obtain some gains in BLEU by using these features derived from topic models to alleviate the over-generation problem in hierarchical phrase-based translation.

Full Paper

Bibliographic reference.  Huang, Songfang / Zhou, Bowen (2011): "Using features from topic models to alleviate over-generation in hierarchical phrase-based translation", In INTERSPEECH-2011, 2097-2100.