Skip to main navigation Skip to search Skip to main content

Improving example-based machine translation with statistical collocation model

  • Zhan Yi Liu*
  • , Sheng Li
  • , Ting Liu
  • , Hai Feng Wang
  • *Corresponding author for this work
  • School of Computer Science and Technology, Harbin Institute of Technology
  • Baidu Inc

Research output: Contribution to journalArticlepeer-review

Abstract

Example-Based machine translation (EBMT) uses a preprocessed bilingual corpus as a main translation knowledge. The final translation is generated by editing examples that match the input sentence. In the EBMT system, the performances of example selection and translation selection heavily influence the quality of the final translation. This paper proposes a method to improve the performance of the EBMT method by using statistical collocation model, which is estimated from monolingual corpora, in three aspects. First, the statistical collocation model is used to estimate the matching degree between the input sentence and examples to improve the performance of the example selection. Second, the performance of translation selection is improved by evaluating the collocation strength of the translation candidates and the context. Third, the collocated words of the translation candidates in the example are detected by the statistical collocation model and then the collocated words are corrected according to the context. In order to evaluate the proposed method, this study conducts a series of experiments. First, the study evaluates the proposed methods in a word-based EBMT system. As compared with the baseline, the methods achieves absolute improvements of 4.73~6.48 BLEU score on English-to-Chinese translation. Then, the study also applies the proposed translation selection method to a semi-structured EBMT system, and the translation qualities are further improved, with an improvement of 1.82 BLEU score. The results of human evaluation show that the translations generated by the improved semi-structured EBMT system can express the majority of the meaning of source sentences, and the fluency of theses translations can also be accepted.

Original languageEnglish
Pages (from-to)1472-1485
Number of pages14
JournalRuan Jian Xue Bao/Journal of Software
Volume23
Issue number6
DOIs
StatePublished - Jun 2012
Externally publishedYes

Keywords

  • Example selection
  • Example-based machine translation
  • Statistical collocation model
  • Translation selection

Fingerprint

Dive into the research topics of 'Improving example-based machine translation with statistical collocation model'. Together they form a unique fingerprint.

Cite this