Projecting named entity recognizers from resource-rich to resource-poor languages without annotated or parallel corpora

Research output: ThesisMaster's thesis

Abstract

Named entity recognition is a challenging task in the field of NLP. As other machine learning problems, it requires a large amount of data for training a workable model. It is still a problem for languages such as Finnish due to the lack of data in linguistic resources. In this thesis, I propose an approach to automatic annotation in Finnish with limited linguistic rules and data of resource-rich language, English, as reference. Training with BiLSTM-CRF model, the preliminary result shows that automatic annotation can produce annotated instances with high accuracy and the model can achieve good performance for Finnish.

In addition to automatic annotation and NER model training, to show the actual application of my Finnish NER model, two related experiments are conducted and discussed at the end of my thesis.
Original languageEnglish
Awarding Institution
  • Department of Computer Science
Supervisors/Advisors
  • Yangarber, Roman, Supervisor
Award date23 Oct 2019
Place of PublicationHelsinki, Finland
Publisher
Publication statusPublished - 21 Jan 2020
MoE publication typeG2 Master's thesis, polytechnic Master's thesis

Fields of Science

  • 113 Computer and information sciences

Cite this