A method for analysing multimodal research material

Audio description in focus

Research output: Chapter in Book/Report/Conference proceedingConference contributionScientificpeer-review

Abstract

A modern text is seldom a stand-alone product consisting merely of writing, but a multimodal body of signs from different meaning-making systems. The multimodal context and the new forms of translation, in which the concept of ‘text’ goes beyond language, have become increasingly relevant in contemporary translation research and practice. In order to study multimodal context and intermodal forms of translation accurately, research methodology has to be adapted. The aim of this article is to present a systematic method for analyzing multimodal material, or 'text', from the point of view of translation analysis, and intermodal translation that takes place in this context. The method is applied to study audio description, a form of translation in which visual information is compensated by verbal descriptions in order to make a text more intelligible to blind and visually impaired audiences. As an illustration, the article looks at how space is constructed in a film and its audio description, and presents a model which allows it to expose and contrast the multiple modes of meaning-making that are at play: in this case, the visual, auditory and linguistic representations of space. The outcome is a systematic presentation of complex audiovisual material in a textual form. The method can be applied to cases whose research material is multimodal and/or which undertake the challenge of
understanding intermodal translation.

Keywords: methodology, multimodality, translation analysis, audio description
Original languageEnglish
Title of host publicationElectronic proceedings of the Kätu symposium on translation and interpreting studies
EditorsRaila Hekkanen, Esa Penttilä, Nestori Siponkoski
Number of pages12
Volume4
Place of PublicationHelsinki
Publication date2010
Publication statusPublished - 2010
MoE publication typeA4 Article in conference proceedings
EventKäTu Symposium on Translation and Interpreting Studies - Helsinki, Finland
Duration: 23 Apr 201024 Apr 2010
Conference number: VIII

Publication series

NameMikaEL : Kääntämisen ja tulkkauksen tutkimuksen symposiumin verkkojulkaisu
Volume4
ISSN (Print)1797-3112

Fields of Science

  • 612 Languages and Literature
  • methodology
  • multimodality
  • translation analysis
  • audio description

Cite this

Hirvonen, M., & Tiittula, L. (2010). A method for analysing multimodal research material: Audio description in focus. In R. Hekkanen, E. Penttilä, & N. Siponkoski (Eds.), Electronic proceedings of the Kätu symposium on translation and interpreting studies (Vol. 4). (MikaEL : Kääntämisen ja tulkkauksen tutkimuksen symposiumin verkkojulkaisu; Vol. 4). Helsinki.
Hirvonen, Maija ; Tiittula, Liisa. / A method for analysing multimodal research material : Audio description in focus. Electronic proceedings of the Kätu symposium on translation and interpreting studies. editor / Raila Hekkanen ; Esa Penttilä ; Nestori Siponkoski. Vol. 4 Helsinki, 2010. (MikaEL : Kääntämisen ja tulkkauksen tutkimuksen symposiumin verkkojulkaisu).
@inproceedings{2b9e02afee7d4ada9c508531316f99a9,
title = "A method for analysing multimodal research material: Audio description in focus",
abstract = "A modern text is seldom a stand-alone product consisting merely of writing, but a multimodal body of signs from different meaning-making systems. The multimodal context and the new forms of translation, in which the concept of ‘text’ goes beyond language, have become increasingly relevant in contemporary translation research and practice. In order to study multimodal context and intermodal forms of translation accurately, research methodology has to be adapted. The aim of this article is to present a systematic method for analyzing multimodal material, or 'text', from the point of view of translation analysis, and intermodal translation that takes place in this context. The method is applied to study audio description, a form of translation in which visual information is compensated by verbal descriptions in order to make a text more intelligible to blind and visually impaired audiences. As an illustration, the article looks at how space is constructed in a film and its audio description, and presents a model which allows it to expose and contrast the multiple modes of meaning-making that are at play: in this case, the visual, auditory and linguistic representations of space. The outcome is a systematic presentation of complex audiovisual material in a textual form. The method can be applied to cases whose research material is multimodal and/or which undertake the challenge ofunderstanding intermodal translation. Keywords: methodology, multimodality, translation analysis, audio description",
keywords = "612 Languages and Literature, methodology, multimodality, translation analysis, audio description, metodologia, multimodaalisuus, k{\"a}{\"a}nn{\"o}sanalyysi, kuvailutulkkaus",
author = "Maija Hirvonen and Liisa Tiittula",
note = "Volume: Proceeding volume: 4",
year = "2010",
language = "English",
volume = "4",
series = "MikaEL : K{\"a}{\"a}nt{\"a}misen ja tulkkauksen tutkimuksen symposiumin verkkojulkaisu",
editor = "Raila Hekkanen and Esa Penttil{\"a} and Nestori Siponkoski",
booktitle = "Electronic proceedings of the K{\"a}tu symposium on translation and interpreting studies",

}

Hirvonen, M & Tiittula, L 2010, A method for analysing multimodal research material: Audio description in focus. in R Hekkanen, E Penttilä & N Siponkoski (eds), Electronic proceedings of the Kätu symposium on translation and interpreting studies. vol. 4, MikaEL : Kääntämisen ja tulkkauksen tutkimuksen symposiumin verkkojulkaisu, vol. 4, Helsinki, KäTu Symposium on Translation and Interpreting Studies, Helsinki, Finland, 23/04/2010.

A method for analysing multimodal research material : Audio description in focus. / Hirvonen, Maija; Tiittula, Liisa.

Electronic proceedings of the Kätu symposium on translation and interpreting studies. ed. / Raila Hekkanen; Esa Penttilä; Nestori Siponkoski. Vol. 4 Helsinki, 2010. (MikaEL : Kääntämisen ja tulkkauksen tutkimuksen symposiumin verkkojulkaisu; Vol. 4).

Research output: Chapter in Book/Report/Conference proceedingConference contributionScientificpeer-review

TY - GEN

T1 - A method for analysing multimodal research material

T2 - Audio description in focus

AU - Hirvonen, Maija

AU - Tiittula, Liisa

N1 - Volume: Proceeding volume: 4

PY - 2010

Y1 - 2010

N2 - A modern text is seldom a stand-alone product consisting merely of writing, but a multimodal body of signs from different meaning-making systems. The multimodal context and the new forms of translation, in which the concept of ‘text’ goes beyond language, have become increasingly relevant in contemporary translation research and practice. In order to study multimodal context and intermodal forms of translation accurately, research methodology has to be adapted. The aim of this article is to present a systematic method for analyzing multimodal material, or 'text', from the point of view of translation analysis, and intermodal translation that takes place in this context. The method is applied to study audio description, a form of translation in which visual information is compensated by verbal descriptions in order to make a text more intelligible to blind and visually impaired audiences. As an illustration, the article looks at how space is constructed in a film and its audio description, and presents a model which allows it to expose and contrast the multiple modes of meaning-making that are at play: in this case, the visual, auditory and linguistic representations of space. The outcome is a systematic presentation of complex audiovisual material in a textual form. The method can be applied to cases whose research material is multimodal and/or which undertake the challenge ofunderstanding intermodal translation. Keywords: methodology, multimodality, translation analysis, audio description

AB - A modern text is seldom a stand-alone product consisting merely of writing, but a multimodal body of signs from different meaning-making systems. The multimodal context and the new forms of translation, in which the concept of ‘text’ goes beyond language, have become increasingly relevant in contemporary translation research and practice. In order to study multimodal context and intermodal forms of translation accurately, research methodology has to be adapted. The aim of this article is to present a systematic method for analyzing multimodal material, or 'text', from the point of view of translation analysis, and intermodal translation that takes place in this context. The method is applied to study audio description, a form of translation in which visual information is compensated by verbal descriptions in order to make a text more intelligible to blind and visually impaired audiences. As an illustration, the article looks at how space is constructed in a film and its audio description, and presents a model which allows it to expose and contrast the multiple modes of meaning-making that are at play: in this case, the visual, auditory and linguistic representations of space. The outcome is a systematic presentation of complex audiovisual material in a textual form. The method can be applied to cases whose research material is multimodal and/or which undertake the challenge ofunderstanding intermodal translation. Keywords: methodology, multimodality, translation analysis, audio description

KW - 612 Languages and Literature

KW - methodology

KW - multimodality

KW - translation analysis

KW - audio description

KW - metodologia

KW - multimodaalisuus

KW - käännösanalyysi

KW - kuvailutulkkaus

M3 - Conference contribution

VL - 4

T3 - MikaEL : Kääntämisen ja tulkkauksen tutkimuksen symposiumin verkkojulkaisu

BT - Electronic proceedings of the Kätu symposium on translation and interpreting studies

A2 - Hekkanen, Raila

A2 - Penttilä, Esa

A2 - Siponkoski, Nestori

CY - Helsinki

ER -

Hirvonen M, Tiittula L. A method for analysing multimodal research material: Audio description in focus. In Hekkanen R, Penttilä E, Siponkoski N, editors, Electronic proceedings of the Kätu symposium on translation and interpreting studies. Vol. 4. Helsinki. 2010. (MikaEL : Kääntämisen ja tulkkauksen tutkimuksen symposiumin verkkojulkaisu).