Experimenting with different machine translation models in medium-resource settings

Publikation: Bidrag til bog/antologi/rapportKonferencebidrag i proceedingsForskningfagfællebedømt

State-of-the-art machine translation (MT) systems rely on the availability of large parallel corpora, containing millions of sentence pairs. For the Icelandic language, the parallel corpus ParIce exists, consisting of about 3.6 million English-Icelandic sentence pairs. Given that parallel corpora for low-resource languages typically contain sentence pairs in the tens or hundreds of thousands, we classify Icelandic as a medium-resource language for MT purposes. In this paper, we present on-going experiments with different MT models, both statistical and neural, for translating English to Icelandic based on ParIce. We describe the corpus and the filtering process used for removing noisy segments, the different models used for training, and the preliminary automatic and human evaluation. We find that, while using an aggressive filtering approach, the most recent neural MT system (Transformer) performs best, obtaining the highest BLEU score and the highest fluency and adequacy scores from human evaluation for in-domain translation. Our work could be beneficial to other languages for which a similar amount of parallel data is available.

OriginalsprogEngelsk
TitelText, Speech, and Dialogue - 23rd International Conference, TSD 2020, Proceedings
RedaktørerPetr Sojka, Ivan Kopecek, Karel Pala, Aleš Horák
Antal sider9
ForlagSpringer
Publikationsdato2020
Sider95-103
ISBN (Trykt)9783030583224
DOI
StatusUdgivet - 2020
Eksternt udgivetJa
Begivenhed23rd International Conference on Text, Speech, and Dialogue, TSD 2020 - Brno, Tjekkiet
Varighed: 8 sep. 202011 sep. 2020

Konference

Konference23rd International Conference on Text, Speech, and Dialogue, TSD 2020
LandTjekkiet
ByBrno
Periode08/09/202011/09/2020
NavnLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Vol/bind12284 LNAI
ISSN0302-9743

Bibliografisk note

Publisher Copyright:
© Springer Nature Switzerland AG 2020.

ID: 371185063