The WMT'18 Morpheval test suites for English-Czech, English-German, English-Finnish and Turkish-English

Franck Burlot; Yves Scherrer; Vinit Ravishankar; Ondřej Bojar; Stig-Arne Grönroos; Maarit Koponen; Tommi Nieminen; François Yvon

The WMT'18 Morpheval test suites for English-Czech, English-German, English-Finnish and Turkish-English

Franck Burlot, Yves Scherrer, Vinit Ravishankar, Ondřej Bojar, Stig-Arne Grönroos, Maarit Koponen, Tommi Nieminen, François Yvon

Department of Signal Processing and Acoustics

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Scientific › peer-review

65 Downloads (Pure)

Abstract

Progress in the quality of machine translation output calls for new automatic evaluation procedures and metrics. In this paper, we extend the Morpheval protocol introduced by Burlot and Yvon (2017) for the English-toCzech and English-to-Latvian translation directions to three additional language pairs, and report its use to analyze the results of WMT 2018’s participants for these language pairs. Considering additional, typologically varied source and target languages also enables us to draw some generalizations regarding this morphology-oriented evaluation procedure

Original language	English
Title of host publication	Third Conference on Machine Translation (WMT18); Brussels, Belgium
Pages	546-560
Number of pages	15
Volume	2
ISBN (Electronic)	978-1-948087-81-0
Publication status	Published - 31 Oct 2018
MoE publication type	A4 Article in a conference publication
Event	Conference on Machine Translation - Brussels, Belgium Duration: 31 Oct 2018 → 1 Dec 2018 Conference number: 3

Conference

Conference	Conference on Machine Translation
Abbreviated title	WMT
Country	Belgium
City	Brussels
Period	31/10/2018 → 01/12/2018

Keywords

machine translation
morphology
evaluation

Access to Document

ELEC_Burlot_wmt18_morpheval_WMT18Final published version, 229 KBLicence: CC BY

http://aclweb.org/anthology/W18-6433Licence: CC BY

1 Active

MeMAD: Methods for Managing Audiovisual Data: Combining Automatic Efficiency with Human Accuracy
Raitio, R., Kurimo, M., Grönroos, S., Brander, T., Rouhe, A., Grósz, T., Virkkunen, A. & Porjazovski, D.
27/12/2017 → 31/03/2021
Project: EU: Framework programmes funding

Cite this

@inproceedings{70f7302d76e14e3d97e2808c0c7b5c5f,

title = "The WMT'18 Morpheval test suites for English-Czech, English-German, English-Finnish and Turkish-English",

abstract = "Progress in the quality of machine translation output calls for new automatic evaluation procedures and metrics. In this paper, we extend the Morpheval protocol introduced by Burlot and Yvon (2017) for the English-toCzech and English-to-Latvian translation directions to three additional language pairs, and report its use to analyze the results of WMT 2018{\textquoteright}s participants for these language pairs. Considering additional, typologically varied source and target languages also enables us to draw some generalizations regarding this morphology-oriented evaluation procedure",

keywords = "machine translation, morphology, evaluation",

author = "Franck Burlot and Yves Scherrer and Vinit Ravishankar and Ond{\v r}ej Bojar and Stig-Arne Gr{\"o}nroos and Maarit Koponen and Tommi Nieminen and Fran{\c c}ois Yvon",

note = "| openaire: EC/H2020/780069/EU//MeMAD; Conference on Machine Translation, WMT ; Conference date: 31-10-2018 Through 01-12-2018",

year = "2018",

month = oct,

day = "31",

language = "English",

volume = "2",

pages = "546--560",

booktitle = "Third Conference on Machine Translation (WMT18); Brussels, Belgium",

}

Burlot, F, Scherrer, Y, Ravishankar, V, Bojar, O, Grönroos, S-A, Koponen, M, Nieminen, T & Yvon, F 2018, The WMT'18 Morpheval test suites for English-Czech, English-German, English-Finnish and Turkish-English. in Third Conference on Machine Translation (WMT18); Brussels, Belgium. vol. 2, pp. 546-560, Conference on Machine Translation, Brussels, Belgium, 31/10/2018. <http://aclweb.org/anthology/W18-6433>

The WMT'18 Morpheval test suites for English-Czech, English-German, English-Finnish and Turkish-English. / Burlot, Franck; Scherrer, Yves; Ravishankar, Vinit; Bojar, Ondřej; Grönroos, Stig-Arne; Koponen, Maarit; Nieminen, Tommi; Yvon, François.

Third Conference on Machine Translation (WMT18); Brussels, Belgium. Vol. 2 2018. p. 546-560.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Scientific › peer-review

TY - GEN

T1 - The WMT'18 Morpheval test suites for English-Czech, English-German, English-Finnish and Turkish-English

AU - Burlot, Franck

AU - Scherrer, Yves

AU - Ravishankar, Vinit

AU - Bojar, Ondřej

AU - Grönroos, Stig-Arne

AU - Koponen, Maarit

AU - Nieminen, Tommi

AU - Yvon, François

N1 - Conference code: 3

PY - 2018/10/31

Y1 - 2018/10/31

N2 - Progress in the quality of machine translation output calls for new automatic evaluation procedures and metrics. In this paper, we extend the Morpheval protocol introduced by Burlot and Yvon (2017) for the English-toCzech and English-to-Latvian translation directions to three additional language pairs, and report its use to analyze the results of WMT 2018’s participants for these language pairs. Considering additional, typologically varied source and target languages also enables us to draw some generalizations regarding this morphology-oriented evaluation procedure

AB - Progress in the quality of machine translation output calls for new automatic evaluation procedures and metrics. In this paper, we extend the Morpheval protocol introduced by Burlot and Yvon (2017) for the English-toCzech and English-to-Latvian translation directions to three additional language pairs, and report its use to analyze the results of WMT 2018’s participants for these language pairs. Considering additional, typologically varied source and target languages also enables us to draw some generalizations regarding this morphology-oriented evaluation procedure

KW - machine translation

KW - morphology

KW - evaluation

M3 - Conference contribution

VL - 2

SP - 546

EP - 560

BT - Third Conference on Machine Translation (WMT18); Brussels, Belgium

T2 - Conference on Machine Translation

Y2 - 31 October 2018 through 1 December 2018

ER -

The WMT'18 Morpheval test suites for English-Czech, English-German, English-Finnish and Turkish-English

Abstract

Conference

Keywords

Access to Document

MeMAD: Methods for Managing Audiovisual Data: Combining Automatic Efficiency with Human Accuracy

Cite this