MT for subtitling: User evaluation of post-editing productivity

Maarit Koponen; Umut Sulubacak; Kaisa Vitikainen; Jörg Tiedemann

MT for subtitling: User evaluation of post-editing productivity

Maarit Koponen, Umut Sulubacak, Kaisa Vitikainen, Jörg Tiedemann

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Scientific › peer-review

Abstract

This paper presents a user evaluation of machine translation and post-editing for TV subtitles. Based on a process study where 12 professional subtitlers translated and post-edited subtitles, we compare effort in terms of task time and number of keystrokes. We also discuss examples of specific subtitling features like condensation, and how these features may have affected the post-editing results. In addition to overall MT quality, segmentation and timing of the subtitles are found to be important issues to be addressed in future work.

Original language	English
Title of host publication	Proceedings of the 22nd Annual Conference of the European Association for Machine Translation (EAMT 2020)
Editors	André Martins, Helena Moniz, Sara Fumega, Bruno Martins, Fernando Batista, Luisa Coheur, Carla Parra, Isabel Trancoso, Marco Turchi, Arianna Bisazza, Joss Moorkens, Ana Guerberof, Mary Nurminen, Lena Marg, Mikel L. Forcada
Number of pages	10
Place of Publication	Geneva
Publisher	European Association for Machine Translation
Publication date	10 Jun 2020
Pages	115-124
ISBN (Electronic)	978-989-33-0589-8
Publication status	Published - 10 Jun 2020
MoE publication type	A4 Article in conference proceedings
Event	Annual Conference of the European Association for Machine Translation - [Online conference], Lisbon, Portugal Duration: 3 Nov 2020 → 5 Nov 2020 Conference number: 22 https://eamt2020.inesc-id.pt/

Fields of Science

113 Computer and information sciences
Natural language processing
Language technology
Machine translation
6121 Languages
Translation studies
Subtitling
Post-editing

Access to Document

Full textFinal published version, 142 KBLicence: CC BY-ND

MeMAD: Methods for Managing Audiovisual Data: Combining Automatic Efficiency with Human Accuracy
Hirvonen, M., Tiedemann, J., Tiittula, L., Sulubacak, U., Vazquez , R. & Koponen, M.
European Commission / Horizon 2020
01/01/2018 → 31/03/2021
Project: Research project

Cite this

Koponen, M., Sulubacak, U., Vitikainen, K., & Tiedemann, J. (2020). MT for subtitling: User evaluation of post-editing productivity. In A. Martins, H. Moniz, S. Fumega, B. Martins, F. Batista, L. Coheur, C. Parra, I. Trancoso, M. Turchi, A. Bisazza, J. Moorkens, A. Guerberof, M. Nurminen, L. Marg, & M. L. Forcada (Eds.), Proceedings of the 22nd Annual Conference of the European Association for Machine Translation (EAMT 2020) (pp. 115-124). European Association for Machine Translation.

Koponen, Maarit ; Sulubacak, Umut ; Vitikainen, Kaisa et al. / MT for subtitling : User evaluation of post-editing productivity. Proceedings of the 22nd Annual Conference of the European Association for Machine Translation (EAMT 2020). editor / André Martins ; Helena Moniz ; Sara Fumega ; Bruno Martins ; Fernando Batista ; Luisa Coheur ; Carla Parra ; Isabel Trancoso ; Marco Turchi ; Arianna Bisazza ; Joss Moorkens ; Ana Guerberof ; Mary Nurminen ; Lena Marg ; Mikel L. Forcada. Geneva : European Association for Machine Translation, 2020. pp. 115-124

@inproceedings{fc232a2e21724527838fb8663e518bcb,

title = "MT for subtitling: User evaluation of post-editing productivity",

abstract = "This paper presents a user evaluation of machine translation and post-editing for TV subtitles. Based on a process study where 12 professional subtitlers translated and post-edited subtitles, we compare effort in terms of task time and number of keystrokes. We also discuss examples of specific subtitling features like condensation, and how these features may have affected the post-editing results. In addition to overall MT quality, segmentation and timing of the subtitles are found to be important issues to be addressed in future work.",

keywords = "113 Computer and information sciences, Natural language processing, Language technology, Machine translation, 6121 Languages, Translation studies, Subtitling, Post-editing",

author = "Maarit Koponen and Umut Sulubacak and Kaisa Vitikainen and J{\"o}rg Tiedemann",

year = "2020",

month = jun,

day = "10",

language = "English",

pages = "115--124",

editor = "Andr{\'e} Martins and Helena Moniz and Sara Fumega and Bruno Martins and Fernando Batista and Luisa Coheur and Carla Parra and Isabel Trancoso and Marco Turchi and Arianna Bisazza and Joss Moorkens and Ana Guerberof and Mary Nurminen and Lena Marg and Forcada, {Mikel L.}",

booktitle = "Proceedings of the 22nd Annual Conference of the European Association for Machine Translation (EAMT 2020)",

publisher = "European Association for Machine Translation",

address = "Switzerland",

note = "Annual Conference of the European Association for Machine Translation , EAMT2020 ; Conference date: 03-11-2020 Through 05-11-2020",

url = "https://eamt2020.inesc-id.pt/",

}

Koponen, M, Sulubacak, U, Vitikainen, K & Tiedemann, J 2020, MT for subtitling: User evaluation of post-editing productivity. in A Martins, H Moniz, S Fumega, B Martins, F Batista, L Coheur, C Parra, I Trancoso, M Turchi, A Bisazza, J Moorkens, A Guerberof, M Nurminen, L Marg & ML Forcada (eds), Proceedings of the 22nd Annual Conference of the European Association for Machine Translation (EAMT 2020). European Association for Machine Translation, Geneva, pp. 115-124, Annual Conference of the European Association for Machine Translation , Lisbon, Portugal, 03/11/2020.

MT for subtitling: User evaluation of post-editing productivity. / Koponen, Maarit; Sulubacak, Umut; Vitikainen, Kaisa et al.
Proceedings of the 22nd Annual Conference of the European Association for Machine Translation (EAMT 2020). ed. / André Martins; Helena Moniz; Sara Fumega; Bruno Martins; Fernando Batista; Luisa Coheur; Carla Parra; Isabel Trancoso; Marco Turchi; Arianna Bisazza; Joss Moorkens; Ana Guerberof; Mary Nurminen; Lena Marg; Mikel L. Forcada. Geneva: European Association for Machine Translation, 2020. p. 115-124.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Scientific › peer-review

TY - GEN

T1 - MT for subtitling

T2 - Annual Conference of the European Association for Machine Translation

AU - Koponen, Maarit

AU - Sulubacak, Umut

AU - Vitikainen, Kaisa

AU - Tiedemann, Jörg

N1 - Conference code: 22

PY - 2020/6/10

Y1 - 2020/6/10

N2 - This paper presents a user evaluation of machine translation and post-editing for TV subtitles. Based on a process study where 12 professional subtitlers translated and post-edited subtitles, we compare effort in terms of task time and number of keystrokes. We also discuss examples of specific subtitling features like condensation, and how these features may have affected the post-editing results. In addition to overall MT quality, segmentation and timing of the subtitles are found to be important issues to be addressed in future work.

AB - This paper presents a user evaluation of machine translation and post-editing for TV subtitles. Based on a process study where 12 professional subtitlers translated and post-edited subtitles, we compare effort in terms of task time and number of keystrokes. We also discuss examples of specific subtitling features like condensation, and how these features may have affected the post-editing results. In addition to overall MT quality, segmentation and timing of the subtitles are found to be important issues to be addressed in future work.

KW - 113 Computer and information sciences

KW - Natural language processing

KW - Language technology

KW - Machine translation

KW - 6121 Languages

KW - Translation studies

KW - Subtitling

KW - Post-editing

M3 - Conference contribution

SP - 115

EP - 124

BT - Proceedings of the 22nd Annual Conference of the European Association for Machine Translation (EAMT 2020)

A2 - Martins, André

A2 - Moniz, Helena

A2 - Fumega, Sara

A2 - Martins, Bruno

A2 - Batista, Fernando

A2 - Coheur, Luisa

A2 - Parra, Carla

A2 - Trancoso, Isabel

A2 - Turchi, Marco

A2 - Bisazza, Arianna

A2 - Moorkens, Joss

A2 - Guerberof, Ana

A2 - Nurminen, Mary

A2 - Marg, Lena

A2 - Forcada, Mikel L.

PB - European Association for Machine Translation

CY - Geneva

Y2 - 3 November 2020 through 5 November 2020

ER -

Koponen M, Sulubacak U, Vitikainen K , Tiedemann J. MT for subtitling: User evaluation of post-editing productivity. In Martins A, Moniz H, Fumega S, Martins B, Batista F, Coheur L, Parra C, Trancoso I, Turchi M, Bisazza A, Moorkens J, Guerberof A, Nurminen M, Marg L, Forcada ML, editors, Proceedings of the 22nd Annual Conference of the European Association for Machine Translation (EAMT 2020). Geneva: European Association for Machine Translation. 2020. p. 115-124

MT for subtitling: User evaluation of post-editing productivity

Abstract

Fields of Science

Access to Document

Projects

MeMAD: Methods for Managing Audiovisual Data: Combining Automatic Efficiency with Human Accuracy

Cite this