The Relevance of the Source Language in Transfer Learning for ASR

Nils Hjortnæs , Niko Partanen, Michael Rießler, Francis M. Tyers

Tutkimustuotos: Artikkeli kirjassa/raportissa/konferenssijulkaisussaKonferenssiartikkeliTieteellinenvertaisarvioitu

Abstrakti

This study presents new experiments on Zyrian Komi speech recognition. We use Deep-Speech to train ASR models from a language documentation corpus that contains both contemporary and archival recordings. Earlier studies have shown that transfer learning from English and using a domain matching Komi language model both improve the CER and WER. In this study we experiment with transfer learning from a more relevant source language, Russian, and including Russian text in the language model construction. The motivation for this is that Russian and Komi are contemporary contact languages, and Russian is regularly present in the corpus. We found that despite the close contact of Russian and Komi, the size of the English speech corpus yielded greater performance when used as the source language. Additionally, we can report that already an update in DeepSpeech version improved the CER by 3.9% against the earlier studies, which is an important step in the development of Komi ASR.
Alkuperäiskielienglanti
OtsikkoProceedings of the 4th Workshop on the Use of Computational Methods in the Study of Endangered Languages
Sivumäärä7
Vuosikerta1
KustantajaThe Association for Computational Linguistics
Julkaisupäivä2021
Sivut63-69
ISBN (elektroninen)978-1-954085-01-5
DOI - pysyväislinkit
TilaJulkaistu - 2021
OKM-julkaisutyyppiA4 Artikkeli konferenssijulkaisuussa
TapahtumaWorkshop on the Use of Computational Methods in the Study of Endangered Languages - Online
Kesto: 2 maalisk. 20213 maalisk. 2021
Konferenssinumero: 4

Julkaisusarja

NimiProceedings of the Workshop on Computational Methods for Endangered Languages
KustantajaUniversity of British Columbia

Tieteenalat

  • 6121 Kielitieteet

Siteeraa tätä