SJTU-NICT's Supervised and Unsupervised Neural Machine Translation Systems for the WMT20 News Translation Task

  • Zuchao Li
  • , Hai Zhao*
  • , Rui Wang*
  • , Kehai Chen
  • , Masao Utiyama
  • , Eiichiro Sumita
  • *Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

In this paper, we introduced our joint team SJTU-NICT's participation in the WMT 2020 machine translation shared task. In this shared task, we participated in four translation directions of three language pairs: English-Chinese, English-Polish on supervised machine translation track, German-Upper Sorbian on low-resource and unsupervised machine translation tracks. Based on different conditions of language pairs, we have experimented with diverse neural machine translation (NMT) techniques: document-enhanced NMT, XLM pre-trained language model enhanced NMT, bidirectional translation as a pre-training, reference language based UNMT, data-dependent gaussian prior objective, and BT-BLEU collaborative filtering self-training. We also used the TF-IDF algorithm to filter the training set to obtain a domain more similar set with the test set for finetuning. In our submissions, the primary systems won the first place on English to Chinese, Polish to English, and German to Upper Sorbian translation directions.

Original languageEnglish
Title of host publication5th Conference on Machine Translation, WMT 2020 - Proceedings
EditorsLoic Barrault, Ondrej Bojar, Fethi Bougares, Rajen Chatterjee, Marta R. Costa-Jussa, Christian Federmann, Mark Fishel, Alexander Fraser, Yvette Graham, Paco Guzman, Barry Haddow, Matthias Huck, Antonio Jimeno Yepes, Philipp Koehn, Andre Martins, Makoto Morishita, Christof Monz, Masaaki Nagata, Toshiaki Nakazawa, Matteo Negri
PublisherAssociation for Computational Linguistics (ACL)
Pages218-219
Number of pages2
ISBN (Electronic)9781948087810
StatePublished - 2020
Externally publishedYes
Event5th Conference on Machine Translation, WMT 2020 - Virtual, Online
Duration: 19 Nov 202020 Nov 2020

Publication series

Name5th Conference on Machine Translation, WMT 2020 - Proceedings

Conference

Conference5th Conference on Machine Translation, WMT 2020
CityVirtual, Online
Period19/11/2020/11/20

Fingerprint

Dive into the research topics of 'SJTU-NICT's Supervised and Unsupervised Neural Machine Translation Systems for the WMT20 News Translation Task'. Together they form a unique fingerprint.

Cite this