Skip to main navigation Skip to search Skip to main content

All in strings: A powerful string-based automatic MT evaluation metric with multiple granularities

  • School of Computer Science and Technology, Harbin Institute of Technology
  • Tianjin University

Research output: Contribution to conferencePaperpeer-review

Abstract

String-based metrics of automatic machine translation (MT) evaluation are widely applied in MT research. Meanwhile, some linguistic motivated metrics have been suggested to improve the string-based metrics in sentencelevel evaluation. In this work, we attempt to change their original calculation units (granularities) of string-based metrics to generate new features. We then propose a powerful string-based automatic MT evaluation metric, combining all the features with various granularities based on SVM rank and regression models. The experimental results show that i) the new features with various granularities can contribute to the automatic evaluation of translation quality; ii) our proposed string-based metrics with multiple granularities based on SVM regression model can achieve higher correlations with human assessments than the state-of-art automatic metrics.

Original languageEnglish
Pages1533-1540
Number of pages8
StatePublished - 2010
Externally publishedYes
Event23rd International Conference on Computational Linguistics, Coling 2010 - Beijing, China
Duration: 23 Aug 201027 Aug 2010

Conference

Conference23rd International Conference on Computational Linguistics, Coling 2010
Country/TerritoryChina
CityBeijing
Period23/08/1027/08/10

Fingerprint

Dive into the research topics of 'All in strings: A powerful string-based automatic MT evaluation metric with multiple granularities'. Together they form a unique fingerprint.

Cite this