• PL 24 (Unioninkatu 40 B)

    00014

    Finland

  • Viikinkaari 1, Biocentre 3

    00790 Helsinki

    Finland

20072020

Research output per year

If you made any changes in Pure these will be visible here soon.

Personal profile

Description of research and teaching

I do research on multimodality, that is, how multiple modes of expression interact and co-operate with each other in different communicative situations.

To exemplify, spoken language, gestures, posture and gaze are constantly coordinated in face-to-face interaction, while magazines, newspapers, websites and other page-based texts organize written language, photographs, illustrations, diagrams, information graphics and other modes of expression into coherent layouts.

In both cases, communication builds on appropriate combinations of different modes of expression. Theories of multimodality attempt to explain how such appropriate combinations are formed and how they become understandable in context.

I am particularly interested in how theories of multimodality can inform research on artificial intelligence, and conversely, how artificial intelligence can support empirical research on multimodality. In addition, I am also interested in applications of natural language processing and computer vision in the humanities and beyond.

Education information

  • Doctor of Philosophy in English Philology from the University of Helsinki, Finland (2014)

  • Master of Arts in English Philology from the University of Helsinki (2007)

  • Bachelor of Arts in English Philology, with minor subjects in Communication, General Linguistics and Russian and East European Studies from the University of Helsinki (2005)

Fields of Science

  • 6121 Languages
  • multimodality
  • digital humanities
  • functional linguistics
  • applied linguistics
  • 113 Computer and information sciences
  • applied computer vision
  • applied machine learning

International and National Collaboration Publications and projects within past five years.

Publications

A multimodal perspective on data visualization

Hiippala, T., 2020, Data Visualization in Society. Engebretsen, M. & Kennedy, H. (eds.). Amsterdam: Amsterdam University Press, p. 277-293 17 p.

Research output: Chapter in Book/Report/Conference proceedingChapterScientificpeer-review

Open Access
File

A question of definitions – foundations for multimodality: A response to Charles Forceville’s review

Bateman, J., Wildfeuer, J. & Hiippala, T., May 2020, In : Visual Communication. 19, 2, p. 317-320 4 p.

Research output: Contribution to journalLiterature review (scientific)Scientific

Book Review: Matthew David Lickiss, Design Perspectives on Multimodal Documents: System, Medium, and Genre Relations

Hiippala, T., Aug 2020, In : Discourse & Communication. 14, 4, p. 443-444 2 p.

Research output: Contribution to journalLiterature review (scientific)Scientific

Multimodalität: Grundlagen, Forschung und Analyse – Eine problemorientierte Einführung

Wildfeuer, J., Bateman, J. A. & Hiippala, T., 2020, Berlin: de Gruyter. 416 p. (De Gruyter Studium)

Research output: Book/ReportBookScientificpeer-review

Projects

Activities

Invited talk at the Centre for Multimodal Communication

Tuomo Hiippala (Speaker)

4 Dec 2019

Activity: Talk or presentation typesInvited talk

Digital Humanities 2020 (Event)

Tuomo Hiippala (Reviewer)

2019 → …

Activity: Publication peer-review and editorial work typesPeer review of manuscripts

Language Resources and Evaluation Conference (Event)

Tuomo Hiippala (Reviewer)

2019

Activity: Publication peer-review and editorial work typesPeer review of manuscripts

Virittäjä (Journal)

Tuomo Hiippala (Reviewer)

2019

Activity: Publication peer-review and editorial work typesPeer review of manuscripts

Reading Beyond Words: Approaches to Multimodality in the Media 2019

Tuomo Hiippala (Speaker: Keynote)

12 Apr 2019

Activity: Participating in or organising an event typesOrganisation and participation in conferences, workshops, courses, seminars

Press / Media

Interview with Helsingin Sanomat

Tuomo Hiippala

15/09/2017

1 item of Media coverage

Press/Media: Press / Media

Yliopistojen kurjistaminen on tietoista politiikkaa

Mika Hyötyläinen & Tuomo Hiippala

13/03/2016

1 Media contribution

Press/Media: Press / Media

Interview with Helsingin Sanomat

Tuomo Hiippala

18/12/2013

1 item of Media coverage

Press/Media: Press / Media

Interview on doctoral studies

Tuomo Hiippala

20/08/2012

1 Media contribution

Press/Media: Press / Media