Projekteja vuodessa
Abstrakti
This paper presents our on-going efforts to develop a com-
prehensive data set and benchmark for machine translation beyond high-
resource languages. The current release includes 500GB of compressed
parallel data for almost 3,000 language pairs covering over 500 languages
and language variants. We present the structure of the data set and
demonstrate its use for systematic studies based on baseline experiments
with multilingual neural machine translation between Uralic languages
and other language groups. Our initial results show the capabilities of
training effective multilingual translation models with skewed training
data but also stress the shortcomings with low-resource settings and
the difficulties to obtain sufficient information through straightforward
transfer from related languages.
prehensive data set and benchmark for machine translation beyond high-
resource languages. The current release includes 500GB of compressed
parallel data for almost 3,000 language pairs covering over 500 languages
and language variants. We present the structure of the data set and
demonstrate its use for systematic studies based on baseline experiments
with multilingual neural machine translation between Uralic languages
and other language groups. Our initial results show the capabilities of
training effective multilingual translation models with skewed training
data but also stress the shortcomings with low-resource settings and
the difficulties to obtain sufficient information through straightforward
transfer from related languages.
| Alkuperäiskieli | englanti |
|---|---|
| Otsikko | Multilingual Facilitation |
| Toimittajat | Mika Hämäläinen, Niko Partanen, Khalid Alnajjar |
| Sivumäärä | 15 |
| Julkaisupaikka | Helsinki |
| Kustantaja | University of Helsinki |
| Julkaisupäivä | 2021 |
| Sivut | 248-262 |
| ISBN (painettu) | 979-8-7133-6227-0 |
| ISBN (elektroninen) | 978-951-51-5025-7 |
| DOI - pysyväislinkit | |
| Tila | Julkaistu - 2021 |
| OKM-julkaisutyyppi | A3 Kirjan tai muun kokoomateoksen osa |
Tieteenalat
- 113 Tietojenkäsittely- ja informaatiotieteet
- 6121 Kielitieteet
-
OPUS: The Open Parallel Corpus
Tiedemann, J. (Projektinjohtaja)
01/06/2004 → …
Projekti: Tutkimusprojekti
-
OPUS-MT: Open Translation Models, Tools and Services
Aulamo, M. (Osallistuja), Nieminen, T. J. (Osallistuja), Hardwick, S. (Osallistuja) & Tiedemann, J. (Projektinjohtaja)
01/08/2020 → 31/08/2021
Projekti: Tutkimusprojekti
-
FoTran: Found in Translation - Natural Language Understanding with Cross-Lingual Grounding
Tiedemann, J. (Projektinjohtaja), Attieh, J. (osallistuja), Aulamo, M. (osallistuja), Celikkanat, H. (osallistuja), De Gibert Bonet, O. (osallistuja), Grönroos, S.-A. (osallistuja), Mickus, T. (osallistuja), Raganato, A. (osallistuja), Scherrer, Y. (osallistuja), Silfverberg, M. (osallistuja), Sjöblom, E. I. (osallistuja), Talman, A. (osallistuja), Vazquez , R. (osallistuja), Virpioja, S. P. (osallistuja), Yli-Jyrä, A. (osallistuja), Zosa, E. (osallistuja), Celikkanat, H. (Osallistuja), Raganato, A. (Osallistuja), Silfverberg, M. (Osallistuja), Sulubacak, U. (Osallistuja) & Vazquez , R. (Osallistuja)
01/09/2018 → 31/03/2024
Projekti: EU Horizon 2020: European Research Council: Consolidator Grant (H2020-ERC-COG)