The WMT18 Morpheval test suites for English–Czech, English–German, English–Finnish and Turkish–English

Franck Burlot, Yves Scherrer, Vinit Ravishankar, Ondřej Bojar, Stig Arne Grönroos, Maarit Koponen, Tommi Nieminen, François Yvon

Forskningsoutput: Kapitel i bok/rapport/konferenshandlingKonferensbidragVetenskapligPeer review

Sammanfattning

Progress in the quality of machine translation output calls for new automatic evaluation procedures and metrics. In this paper, we extend the Morpheval protocol introduced by Burlot and Yvon (2017) for the English-to-Czech and English-to-Latvian translation directions to three additional language pairs, and report its use to analyze the results of WMT 2018’s participants for these language pairs. Considering additional, typologically varied source and target languages also enables us to draw some generalizations regarding this morphology-oriented evaluation procedure.

Originalspråkengelska
Titel på värdpublikationShared Task Papers
Antal sidor15
FörlagAssociation for Computational Linguistics (ACL)
Utgivningsdatum2018
Sidor546-560
ISBN (elektroniskt)9781948087810
DOI
StatusPublicerad - 2018
MoE-publikationstypA4 Artikel i en konferenspublikation
Evenemang3rd Conference on Machine Translation, WMT 2018 at the Conference on Empirical Methods in Natural Language Processing, EMNLP 2018 - Brussels, Belgien
Varaktighet: 31 okt. 20181 nov. 2018

Publikationsserier

NamnWMT 2018 - 3rd Conference on Machine Translation, Proceedings of the Conference
Volym2

Bibliografisk information

Publisher Copyright:
©2018 Association for Computational Linguistics

Citera det här