• PL 24 (Unioninkatu 40)

    00014

    Finland

  • Finland

  • PL 24

    00014 University of Helsinki

    Finland

Accepting PhD Students

20042020
If you made any changes in Pure these will be visible here soon.

Personal profile

Description of research and teaching

I'm currently conducting two research projects:

  • MUTABLE: Multimodal Translation with the Blind (2017-2019, Academy of Finland), blogs.helsinki.fi/audiodescription
  • MeMAD: Methods for Managing Audiovisual Data: Combining human accuracy with computational efficiency (2018-2020, EU Horizon2020)

In MUTABLE, I study the translation process from the perspective of multimodal interaction and collaboration between translators and users. As a case in point is the audio description process in which a team of sighted and blind describers creates an audio description of a film. Audio description means verbally translating visual elements of an audiovisual narrative for the benefit of visually impaired persons, enhancing their access to visual and audiovisual culture. My project combines Translation Studies, Linguistics and Film Studies with interactional, multimodal, and cognitive scientific perspectives. Drawing on socio-cognitive analysis of translation processes and multimodal analysis of interaction, the project collects and investigates data from authentic audio description processes in Finland, Germany and Austria. The primary data consist of video recordings of face-to-face encounters between audio describers.

In MeMAD, an international consortium of research and business partners develop methods of accessing audiovisual content through language (audio and content descriptions, and subtitling). The idea is to combine human and machine translation to create an improved model of information extraction, retrieval and search. The method will benefit in particular the Creative Industries in dealing with the ever-growing amount of audiovisual big data, such as videos and films, but it can also be adapted to improve the access services as semi-automatic audio description and subtitling.

In general, my research interests are:

  • intermodal translation (audio description, subtitling, multisensory interpreting, environmental description)
  • accessibility
  • multimodality in translation and interpreting
  • multimodal interaction, asymmetrical interaction
  • human-machine interaction
  • multimodal machine translation
  • media culture, film studies
  • cognitive linguistics
  • shared cognition, cultural cognition

I teach BA and MA level courses in translation studies and supervise MA and doctoral theses. Here's an example of my teaching, featuring a video lecture about accessibility services in multimodal translation (hosted by UniTube).

Outside the university, I am elected member of Young Academy of Finland (2017-2021; information in Finnish) and member of its board. I am audio describer and member of the audio description board of the organisation "Cultural Service for the Visually Impaired" (Näkövammaisten kulttuuripalvelu ry) in Finland.

 

Keywords

  • 6160 Other humanities
  • Translation Studies
  • 6121 Languages
  • 613 Arts
  • Film studies
  • 518 Media and communications
  • Multimodality

International and National Collaboration Publications and projects within past five years.

Selected Publications 2004 2018

Kuvailutulkkaus Euroopan mittakaavassa

Hirvonen, M. I., 2017, In : Näkövammaisten Airut. 11, 1 p.

Research output: Contribution to journalArticleGeneral public

Open Access

Kattava yleisteos kielensisäisestä kääntämisestä ja tulkkauksesta [Kirja-arvostelu]

Hirvonen, M. I., 2017, In : Kääntäjä - Översättaren. 2, p. 30-31 2 p.

Research output: Contribution to journalArticleProfessional

Open Access

Imaginary places – Verbalization of setting in the English, German and Spanish audio descriptions of Slumdog Millionaire

Hirvonen, M. I. & Igareda, P., 2017, In : mtm - A translation journal. 9, p. 341-364 24 p.

Research output: Contribution to journalArticleScientificpeer-review

Audiodeskription und Sichtdolmetschen: Translation über Sinnesgrenzen: Eine Begriffsanalyse

Hirvonen, M. I., 2018, Spielräume der Translation: Dolmetschen und Übersetzen in Theorie und Praxis. Kvam, S., Meloni, I., Parianou, A., Schopp, J. & Solfjeld, K. (eds.). Münster: Waxmann

Research output: Chapter in Book/Report/Conference proceedingChapterScientificpeer-review

Kun ei näe - audiovisuaalisen kulttuurin saavuttamattomuus sokean kuulokulmasta

Hirvonen, M. I. & Ojanen, M., 2017, In : Lähikuva. 30, 3, p. 86-93 8 p.

Research output: Contribution to journalArticleScientific

Open Access

Multimodaalisen aineiston analyysi ja havainnollistaminen kuvailutulkkauksen tutkimuksessa

Hirvonen, M., 2016, Kääntäminen, tulkkaus ja multimodaalisuus: menetelmiä monimuotoisten viestien tutkimiseen. Ikonen, T. & Toikkanen, J. (eds.). Tampere: University of Tampere, p. 121-138 18 p. (Tampere Studies in Language, Translation and Literature: B3).

Research output: Chapter in Book/Report/Conference proceedingChapterScientific

Towards Reliable Automatic Multimodal Content Analysis

Lautenbacher, O-P., Tiittula, L., Hirvonen, M., Laaksonen, J. & Kurimo, M., 2015, TheWorkshop on Vision and Language 2015 (VL’15) - VISION AND LANGUAGE MEET COGNITIVE SYSTEMS : Proceedings. The Association for Computational Linguistics, p. 6-7 2 p.

Research output: Chapter in Book/Report/Conference proceedingConference contributionScientificpeer-review

Katsaus multimodaalisuuteen käännöstieteessä

Tuominen, T., Hirvonen, M., Ketola, A., Pitkäsalo, E. & Isolahti, N., 2016, Kääntäminen, tulkkaus ja multimodaalisuus: menetelmiä monimuotoisten viestien tutkimiseen. Pitkäsalo, E. & Isolahti, N. (eds.). Tampere: University of Tampere, p. 11-24 14 p. (Tampere Studies in Language, Translation and Literature: B3).

Research output: Chapter in Book/Report/Conference proceedingChapterScientific

Open Access

Multimodal Representation and Intermodal Similarity: Cues of Space in the Audio Description of Film

Hirvonen, M., 2014, Helsinki: University of Helsinki. 133 p.

Research output: ThesisDoctoral ThesisCollection of Articles

Intermodaalinen kääntäminen ja tulkkaus

Tiittula, L. & Hirvonen, M., 2015, Käännetyt maailmat: Johdatus käännösviestintään. Aaltonen, S., Siponkoski, N. & Abdallah, K. (eds.). Helsinki: Gaudemus, p. 252-271 20 p.

Research output: Chapter in Book/Report/Conference proceedingChapterScientificpeer-review

Verfahren der Hörbarmachung von Raum: Analyse einer Hörfilmsequenz

Hirvonen, M. & Tiittula, L., 2012, Raum als interaktive Ressource. Hausendorf, H., Mondada, L. & Schmitt, R. (eds.). Tübingen: Gunter Narr Verlag, p. 381-427 47 p. (Studien zur Deutschen Sprache; no. 62).

Research output: Chapter in Book/Report/Conference proceedingChapterScientificpeer-review

A method for analysing multimodal research material: Audio description in focus

Hirvonen, M. & Tiittula, L., 2010, Electronic proceedings of the Kätu symposium on translation and interpreting studies. Hekkanen, R., Penttilä, E. & Siponkoski, N. (eds.). Helsinki, Vol. 4. 12 p. (MikaEL : Kääntämisen ja tulkkauksen tutkimuksen symposiumin verkkojulkaisu; vol. 4).

Research output: Chapter in Book/Report/Conference proceedingConference contributionScientificpeer-review

Contrasting Visual and Verbal Cueing of Space: strategies and devices in the audio description of film

Hirvonen, M., May 2012, In : New voices in translation studies. 2012, 8, p. 21-43

Research output: Contribution to journalArticleScientificpeer-review

Selected Projects 2013 2020

Datasets

Multimodal translation in audio description

Hirvonen, M. I. (Creator), Maija Hirvonen, 2016

Dataset

Selected Activities 2009 2018

Translation as interactive meaning constitution and negotiation

Maija Hirvonen (Speaker)
13 Mar 2018

Activity: Talk or presentation typesInvited talk

File

Teamwork between blind and sighted persons: Effects of visual asymmetry on intersubjectivity

Maija Inkeri Hirvonen (Speaker), Liisa Tiittula (Speaker)
11 May 2017

Activity: Talk or presentation typesOral presentation

University of Vienna

Maija Hirvonen (Visiting researcher)
19 Jan 201818 Mar 2018

Activity: Visiting an external institution typesAcademic visit to other institution

Nuorten tiedeakatemian klubi - Young Academy Club

Maija Hirvonen (Speaker)
14 May 2018

Activity: Talk or presentation typesInvited talk

WRITING VOICE AND SPEAKING TEXT

Mari Wiklund (Speaker: Presenter), Maija Inkeri Hirvonen (Speaker: Presenter)
7 Jun 2018

Activity: Participating in or organising an event typesOrganisation and participation in conferences, workshops, courses, seminars

Skolar Award (pitching competition for postdocs)

Maija Hirvonen (Speaker: Presenter)
29 Nov 20161 Dec 2016

Activity: Participating in or organising an event typesPublic Talks

EST 2016: Moving Boundaries

Maija Hirvonen (Poster Presentation)
16 Sep 201617 Sep 2016

Activity: Participating in or organising an event typesOrganisation and participation in conferences, workshops, courses, seminars

Institut für Deutsche Sprache

Maija Hirvonen (Visiting researcher)
1 Oct 201125 Oct 2011

Activity: Visiting an external institution typesAcademic visit to other institution

Institut für Deutsche Sprache

Maija Hirvonen (Visiting researcher)
1 Mar 201130 Apr 2011

Activity: Visiting an external institution typesAcademic visit to other institution

Selected Press / Media

News and articles on my research in audio description

Maija Inkeri Hirvonen

01/01/201510/01/2017

4 items of media coverage

Press/Media: Press / Media

News, articles and interviews on the MeMAD project

Maija Inkeri Hirvonen

19/03/2018

1 item of media coverage

Press/Media: Press / Media

Training of students in accessibility services (subtitling, audio description) at University of Helsinki

Maija Inkeri Hirvonen

25/09/201411/03/2015

2 items of media coverage, 1 media contribution

Press/Media: Press / Media