LT@Helsinki at SemEval-2020 Task 12: Multilingual or language-specific BERT?

Marc Pàmies; Emily Öhman; Kaisla Kajava; Jörg Tiedemann

LT@Helsinki at SemEval-2020 Task 12: Multilingual or language-specific BERT?

Marc Pàmies, Emily Öhman, Kaisla Kajava, Jörg Tiedemann

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Scientific › peer-review

Abstract

This paper presents the different models submitted by the LT@Helsinki team for the SemEval2020 Shared Task 12. Our team participated in sub-tasks A and C; titled offensive language identification and offense target identification, respectively. In both cases we used the so called Bidirectional Encoder Representation from Transformer (BERT), a model pre-trained by Google and fine-tuned by us on the OLID dataset. The results show that offensive tweet classification is one of several language-based tasks where BERT can achieve state-of-the-art results.

Original language	English
Title of host publication	Proceedings of the Fourteenth Workshop on Semantic Evaluation
Editors	Aurelie Herbelot, Xiaodan Zhu, Alexis Palmer, Nathan Schneider, Jonathan May, Ekaterina Shutova
Number of pages	7
Place of Publication	Barcelona
Publisher	International Committee for Computational Linguistics
Publication date	2020
Pages	1569-1575
ISBN (Electronic)	978-1-952148-31-6
Publication status	Published - 2020
MoE publication type	A4 Article in conference proceedings
Event	International Workshop on Semantic Evaluation - [Online event], Barcelona, Spain Duration: 12 Dec 2020 → 13 Dec 2020 Conference number: 14 http://alt.qcri.org/semeval2020/

Fields of Science

113 Computer and information sciences
6121 Languages

Access to Document

2020.semeval-1.205Final published version, 151 KBLicence: CC BY

Cite this

Pàmies, Marc ; Öhman, Emily ; Kajava, Kaisla et al. / LT@Helsinki at SemEval-2020 Task 12 : Multilingual or language-specific BERT?. Proceedings of the Fourteenth Workshop on Semantic Evaluation. editor / Aurelie Herbelot ; Xiaodan Zhu ; Alexis Palmer ; Nathan Schneider ; Jonathan May ; Ekaterina Shutova. Barcelona : International Committee for Computational Linguistics, 2020. pp. 1569-1575

@inproceedings{93f8750233e445338030c54a13e20fd0,

title = "LT@Helsinki at SemEval-2020 Task 12: Multilingual or language-specific BERT?",

abstract = "This paper presents the different models submitted by the LT@Helsinki team for the SemEval2020 Shared Task 12. Our team participated in sub-tasks A and C; titled offensive language identification and offense target identification, respectively. In both cases we used the so called Bidirectional Encoder Representation from Transformer (BERT), a model pre-trained by Google and fine-tuned by us on the OLID dataset. The results show that offensive tweet classification is one of several language-based tasks where BERT can achieve state-of-the-art results.",

keywords = "113 Computer and information sciences, 6121 Languages",

author = "Marc P{\`a}mies and Emily {\"O}hman and Kaisla Kajava and J{\"o}rg Tiedemann",

year = "2020",

language = "English",

pages = "1569--1575",

editor = "Herbelot, {Aurelie } and Zhu, {Xiaodan } and Palmer, {Alexis } and Nathan Schneider and May, {Jonathan } and Shutova, {Ekaterina }",

booktitle = "Proceedings of the Fourteenth Workshop on Semantic Evaluation",

publisher = "International Committee for Computational Linguistics",

address = "Unknown",

note = "International Workshop on Semantic Evaluation, SemEval-2020 ; Conference date: 12-12-2020 Through 13-12-2020",

url = "http://alt.qcri.org/semeval2020/",

}

Pàmies, M, Öhman, E, Kajava, K & Tiedemann, J 2020, LT@Helsinki at SemEval-2020 Task 12: Multilingual or language-specific BERT? in A Herbelot, X Zhu, A Palmer, N Schneider, J May & E Shutova (eds), Proceedings of the Fourteenth Workshop on Semantic Evaluation. International Committee for Computational Linguistics, Barcelona, pp. 1569-1575, International Workshop on Semantic Evaluation, Barcelona, Spain, 12/12/2020.

LT@Helsinki at SemEval-2020 Task 12: Multilingual or language-specific BERT? / Pàmies, Marc; Öhman, Emily; Kajava, Kaisla et al.
Proceedings of the Fourteenth Workshop on Semantic Evaluation. ed. / Aurelie Herbelot; Xiaodan Zhu; Alexis Palmer; Nathan Schneider; Jonathan May; Ekaterina Shutova. Barcelona: International Committee for Computational Linguistics, 2020. p. 1569-1575.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Scientific › peer-review

TY - GEN

T1 - LT@Helsinki at SemEval-2020 Task 12

T2 - International Workshop on Semantic Evaluation

AU - Pàmies, Marc

AU - Öhman, Emily

AU - Kajava, Kaisla

AU - Tiedemann, Jörg

N1 - Conference code: 14

PY - 2020

Y1 - 2020

N2 - This paper presents the different models submitted by the LT@Helsinki team for the SemEval2020 Shared Task 12. Our team participated in sub-tasks A and C; titled offensive language identification and offense target identification, respectively. In both cases we used the so called Bidirectional Encoder Representation from Transformer (BERT), a model pre-trained by Google and fine-tuned by us on the OLID dataset. The results show that offensive tweet classification is one of several language-based tasks where BERT can achieve state-of-the-art results.

AB - This paper presents the different models submitted by the LT@Helsinki team for the SemEval2020 Shared Task 12. Our team participated in sub-tasks A and C; titled offensive language identification and offense target identification, respectively. In both cases we used the so called Bidirectional Encoder Representation from Transformer (BERT), a model pre-trained by Google and fine-tuned by us on the OLID dataset. The results show that offensive tweet classification is one of several language-based tasks where BERT can achieve state-of-the-art results.

KW - 113 Computer and information sciences

KW - 6121 Languages

M3 - Conference contribution

SP - 1569

EP - 1575

BT - Proceedings of the Fourteenth Workshop on Semantic Evaluation

A2 - Herbelot, Aurelie

A2 - Zhu, Xiaodan

A2 - Palmer, Alexis

A2 - Schneider, Nathan

A2 - May, Jonathan

A2 - Shutova, Ekaterina

PB - International Committee for Computational Linguistics

CY - Barcelona

Y2 - 12 December 2020 through 13 December 2020

ER -