The Great Misalignment Problem in Human Evaluation of NLP Methods

Mika Hämäläinen; Khalid Alnajjar

The Great Misalignment Problem in Human Evaluation of NLP Methods

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Scientific › peer-review

Original language	English
Title of host publication	Proceedings of the Workshop on Human Evaluation of NLP Systems (HumEval)
Editors	Anya Belz, Shubham Agarwal, Yvette Graham, Ehud Reiter, Anastasia Shimorina
Number of pages	6
Place of Publication	Stroudsburg
Publisher	The Association for Computational Linguistics
Publication date	2021
Pages	69-74
ISBN (Electronic)	978-1-954085-10-7
Publication status	Published - 2021
MoE publication type	A4 Article in conference proceedings
Event	European Chapter of the Association for Computational Linguistics - [Virtual conference] Duration: 19 Apr 2021 → 23 Apr 2021 Conference number: 16 https://2021.eacl.org/

Fields of Science

113 Computer and information sciences
6121 Languages

Access to Document

2021.humeval-1.8Final published version, 139 KBLicence: CC BY-NC

https://www.aclweb.org/anthology/2021.humeval-1.8Licence: CC BY

Human Evaluation of Creative NLG Systems: An Interdisciplinary Survey on Recent Papers
Mika Hämäläinen (Speaker) & Khalid Alnajjar (Speaker)
20 Jan 2022
Activity: Talk or presentation types › Oral presentation

Cite this

@inproceedings{3a5a5943607346358b78a2cb12d49ee0,

title = "The Great Misalignment Problem in Human Evaluation of NLP Methods",

keywords = "113 Computer and information sciences, 6121 Languages",

author = "Mika H{\"a}m{\"a}l{\"a}inen and Khalid Alnajjar",

year = "2021",

language = "English",

pages = "69--74",

editor = "Belz, {Anya } and Agarwal, {Shubham } and Graham, {Yvette } and Reiter, {Ehud } and Shimorina, {Anastasia }",

booktitle = "Proceedings of the Workshop on Human Evaluation of NLP Systems (HumEval)",

publisher = "The Association for Computational Linguistics",

address = "United States",

note = "European Chapter of the Association for Computational Linguistics, EACL 2021 ; Conference date: 19-04-2021 Through 23-04-2021",

url = "https://2021.eacl.org/",

}

Hämäläinen, M & Alnajjar, K 2021, The Great Misalignment Problem in Human Evaluation of NLP Methods. in A Belz, S Agarwal, Y Graham, E Reiter & A Shimorina (eds), Proceedings of the Workshop on Human Evaluation of NLP Systems (HumEval). The Association for Computational Linguistics, Stroudsburg, pp. 69-74, European Chapter of the Association for Computational Linguistics, 19/04/2021. <https://www.aclweb.org/anthology/2021.humeval-1.8>

The Great Misalignment Problem in Human Evaluation of NLP Methods. / Hämäläinen, Mika ; Alnajjar, Khalid.

Proceedings of the Workshop on Human Evaluation of NLP Systems (HumEval). ed. / Anya Belz; Shubham Agarwal; Yvette Graham; Ehud Reiter; Anastasia Shimorina. Stroudsburg : The Association for Computational Linguistics, 2021. p. 69-74.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Scientific › peer-review

TY - GEN

T1 - The Great Misalignment Problem in Human Evaluation of NLP Methods

AU - Hämäläinen, Mika

AU - Alnajjar, Khalid

N1 - Conference code: 16

PY - 2021

Y1 - 2021

KW - 113 Computer and information sciences

KW - 6121 Languages

M3 - Conference contribution

SP - 69

EP - 74

BT - Proceedings of the Workshop on Human Evaluation of NLP Systems (HumEval)

A2 - Belz, Anya

A2 - Agarwal, Shubham

A2 - Graham, Yvette

A2 - Reiter, Ehud

A2 - Shimorina, Anastasia

PB - The Association for Computational Linguistics

CY - Stroudsburg

T2 - European Chapter of the Association for Computational Linguistics

Y2 - 19 April 2021 through 23 April 2021

ER -

The Great Misalignment Problem in Human Evaluation of NLP Methods

Fields of Science

Access to Document

Activities

Human Evaluation of Creative NLG Systems: An Interdisciplinary Survey on Recent Papers

Cite this