TY - GEN
T1 - Diagnostic evaluation of machine translation systems using automatically constructed linguistic check-points
AU - Zhou, Ming
AU - Wang, Bo
AU - Liu, Shujie
AU - Li, Mu
AU - Zhang, Dongdong
AU - Zhao, Tiejun
PY - 2008
Y1 - 2008
N2 - We present a diagnostic evaluation platform which provides multi-factored evaluation based on automatically constructed check-points. A check-point is a linguistically motivated unit (e.g. an ambiguous word, a noun phrase, a verb∼obj collocation, a prepositional phrase etc.), which are pre-defined in a linguistic taxonomy. We present a method that automatically extracts check-points from parallel sentences. By means of checkpoints, our method can monitor a MT system in translating important linguistic phenomena to provide diagnostic evaluation. The effectiveness of our approach for diagnostic evaluation is verified through experiments on various types of MT systems.
AB - We present a diagnostic evaluation platform which provides multi-factored evaluation based on automatically constructed check-points. A check-point is a linguistically motivated unit (e.g. an ambiguous word, a noun phrase, a verb∼obj collocation, a prepositional phrase etc.), which are pre-defined in a linguistic taxonomy. We present a method that automatically extracts check-points from parallel sentences. By means of checkpoints, our method can monitor a MT system in translating important linguistic phenomena to provide diagnostic evaluation. The effectiveness of our approach for diagnostic evaluation is verified through experiments on various types of MT systems.
UR - https://www.scopus.com/pages/publications/72249120776
U2 - 10.3115/1599081.1599222
DO - 10.3115/1599081.1599222
M3 - 会议稿件
AN - SCOPUS:72249120776
SN - 9781905593446
T3 - Coling 2008 - 22nd International Conference on Computational Linguistics, Proceedings of the Conference
SP - 1121
EP - 1128
BT - Coling 2008 - 22nd International Conference on Computational Linguistics, Proceedings of the Conference
PB - Association for Computational Linguistics (ACL)
T2 - 22nd International Conference on Computational Linguistics, Coling 2008
Y2 - 18 August 2008 through 22 August 2008
ER -