Maija Hirvonen

Person

Description of research and teaching

I'm currently conducting two research projects:

  • MUTABLE: Multimodal Translation with the Blind (2017-2019, Academy of Finland), blogs.helsinki.fi/audiodescription
  • MeMAD: Methods for Managing Audiovisual Data: Combining human accuracy with computational efficiency (2018-2020, EU Horizon2020)

In MUTABLE, I study the translation process from the perspective of multimodal interaction and collaboration between translators and users. As a case in point is the audio description process in which a team of sighted and blind describers creates an audio description of a film. Audio description means verbally translating visual elements of an audiovisual narrative for the benefit of visually impaired persons, enhancing their access to visual and audiovisual culture. My project combines Translation Studies, Linguistics and Film Studies with interactional, multimodal, and cognitive scientific perspectives. Drawing on socio-cognitive analysis of translation processes and multimodal analysis of interaction, the project collects and investigates data from authentic audio description processes in Finland, Germany and Austria. The primary data consist of video recordings of face-to-face encounters between audio describers.

In MeMAD, an international consortium of research and business partners develop methods of accessing audiovisual content through language (audio and content descriptions, and subtitling). The idea is to combine human and machine translation to create an improved model of information extraction, retrieval and search. The method will benefit in particular the Creative Industries in dealing with the ever-growing amount of audiovisual big data, such as videos and films, but it can also be adapted to improve the access services as semi-automatic audio description and subtitling.

In general, my research interests are:

  • intermodal translation (audio description, subtitling, multisensory interpreting, environmental description)
  • accessibility
  • multimodality in translation and interpreting
  • multimodal interaction, asymmetrical interaction
  • human-machine interaction
  • multimodal machine translation
  • media culture, film studies
  • cognitive linguistics
  • shared cognition, cultural cognition

I teach BA and MA level courses in translation studies and supervise MA and doctoral theses. Here's an example of my teaching, featuring a video lecture about accessibility services in multimodal translation (hosted by UniTube).

Outside the university, I am elected member of Young Academy of Finland (2017-2021; information in Finnish) and member of its board. I am audio describer and member of the audio description board of the organisation "Cultural Service for the Visually Impaired" (Näkövammaisten kulttuuripalvelu ry) in Finland.

 

Close

Highlighted publications

  1. Kun ei näe - audiovisuaalisen kulttuurin saavuttamattomuus sokean kuulokulmasta

    Hirvonen, M. I. & Ojanen, M. 2017 In : Lähikuva : Turun elokuvakerho ry:n jäsenlehti.. 30, 3, p. 86-93 8 p.

    Research output: ScientificArticle

  2. Multimodaalisen aineiston analyysi ja havainnollistaminen kuvailutulkkauksen tutkimuksessa

    Hirvonen, M. 2016 Kääntäminen, tulkkaus ja multimodaalisuus: menetelmiä monimuotoisten viestien tutkimiseen. Ikonen, T. & Toikkanen, J. (eds.). Tampere: University of Tampere, p. 121-138 18 p. (Tampere Studies in Language, Translation and Literature: B3)

    Research output: ScientificChapter

  3. Towards Reliable Automatic Multimodal Content Analysis

    Lautenbacher, O-P., Tiittula, L., Hirvonen, M., Laaksonen, J. & Kurimo, M. 2015 TheWorkshop on Vision and Language 2015 (VL’15) - VISION AND LANGUAGE MEET COGNITIVE SYSTEMS : Proceedings. The Association for Computational Linguistics, p. 6-7 2 p.

    Research output: Scientific - peer-reviewConference contribution

  4. Katsaus multimodaalisuuteen käännöstieteessä

    Tuominen, T., Hirvonen, M., Ketola, A., Pitkäsalo, E. & Isolahti, N. 2016 Kääntäminen, tulkkaus ja multimodaalisuus: menetelmiä monimuotoisten viestien tutkimiseen. Pitkäsalo, E. & Isolahti, N. (eds.). Tampere: University of Tampere, p. 11-24 14 p. (Tampere Studies in Language, Translation and Literature: B3)

    Research output: ScientificChapter

  5. Multimodal Representation and Intermodal Similarity: Cues of Space in the Audio Description of Film

    Hirvonen, M. 2014 Helsinki: University of Helsinki. 133 p.

    Research output: Collection of ArticlesDoctoral Thesis

  6. SKY Journal of Linguistics 28: Journal of the Linguistic Association of Finland

    Hamunen, M. V. J. (ed.), Hirvonen, M. I. (ed.), Laippala, V. (ed.), Lantto, H. (ed.) & Rauniomaa, M. (ed.) 25 Jan 2016 Helsinki: Suomen kielitieteellinen yhdistys. 427 p. (SKY Journal of Linguistics; vol. 28)

    Research output: Scientific - peer-reviewAnthology or special issue

  7. Intermodaalinen kääntäminen ja tulkkaus

    Tiittula, L. & Hirvonen, M. 2015 Käännetyt maailmat: Johdatus käännösviestintään. Aaltonen, S., Siponkoski, N. & Abdallah, K. (eds.). Helsinki: Gaudemus, p. 252-271 20 p.

    Research output: Scientific - peer-reviewChapter

  8. Verfahren der Hörbarmachung von Raum: Analyse einer Hörfilmsequenz

    Hirvonen, M. & Tiittula, L. 2012 Raum als interaktive Ressource. Hausendorf, H., Mondada, L. & Schmitt, R. (eds.). Tübingen: Gunter Narr Verlag, p. 381-427 47 p. (Studien zur Deutschen Sprache; no. 62)

    Research output: Scientific - peer-reviewChapter

  9. A method for analysing multimodal research material: Audio description in focus

    Hirvonen, M. & Tiittula, L. 2010 Electronic proceedings of the Kätu symposium on translation and interpreting studies. Hekkanen, R., Penttilä, E. & Siponkoski, N. (eds.). Helsinki, Vol. 4, 12 p. (MikaEL : Kääntämisen ja tulkkauksen tutkimuksen symposiumin verkkojulkaisu; vol. 4)

    Research output: Scientific - peer-reviewConference contribution

  10. Contrasting Visual and Verbal Cueing of Space: strategies and devices in the audio description of film

    Hirvonen, M. May 2012 In : New voices in translation studies. 2012, 8, p. 21-43

    Research output: Scientific - peer-reviewArticle

View all (21) »

Highlighted activities

  1. Skolar Award (pitching competition for postdocs)

    Hirvonen, M. (Speaker: Presenter)
    29 Nov 20161 Dec 2016

    Activity: Participating in or organising an eventPublic Talks

  2. SKY Journal of Linguistics (Journal)

    Hirvonen, M. (Editor)
    2015 → …

    Activity: Publication peer-review and editorial workEditor of research journal

  3. Routledge (Publisher)

    Hirvonen, M. (Reviewer)
    1 Nov 201628 Nov 2016

    Activity: Publication peer-review and editorial workPeer review of manuscripts

  4. Reviewer of scientific articles (Journal)

    Hirvonen, M. (Reviewer)
    2016 → …

    Activity: Publication peer-review and editorial workPeer review of manuscripts

  5. BAULT (Building and Using Language Technology) Symposium 2016

    Hirvonen, M. (Poster Presentation)
    1 Dec 20162 Dec 2016

    Activity: Participating in or organising an eventPublic Talks

  6. Spielräume der Translation: Sprach- und translationswissenschaftliche Zugänge

    Hirvonen, M. (Speaker: Opponent/discussant)
    23 Oct 201626 Oct 2016

    Activity: Participating in or organising an eventOrganisation and participation in conferences, workshops, courses, seminars

  7. EST 2016: Moving Boundaries

    Hirvonen, M. (Poster Presentation)
    16 Sep 201617 Sep 2016

    Activity: Participating in or organising an eventOrganisation and participation in conferences, workshops, courses, seminars

  8. Finnish Conference of Linguistics

    Hirvonen, M. (Speaker: Presenter)
    26 May 2016

    Activity: Participating in or organising an eventOrganisation and participation in conferences, workshops, courses, seminars

  9. Seminar on Multimodality in Translation and Interpreting

    Hirvonen, M. (Speaker: Presenter)
    21 Apr 2016

    Activity: Participating in or organising an eventOrganisation and participation in conferences, workshops, courses, seminars

  10. Kuvailutulkkaustoimikunta (Audio Description Committee) (External organisation)

    Hirvonen, M. (Board member)
    1 Jan 2010 → …

    Activity: MembershipMembership or other role in national/international committee, council, board

  11. Institut für Deutsche Sprache

    Hirvonen, M. (Visiting researcher)
    1 Oct 201125 Oct 2011

    Activity: Visiting an external institutionAcademic visit to other institution

  12. Institut für Deutsche Sprache

    Hirvonen, M. (Visiting researcher)
    1 Mar 201130 Apr 2011

    Activity: Visiting an external institutionAcademic visit to other institution

View all (47) »

ID: 11722859