Personal profile

Research interests

I'm a computational linguist and language technology researcher. My research focuses on natural language understanding, reasoning and natural language inference using machine learning. I’m interested in what understanding language consists of, how it can be modelled in AI and how these models can be evaluated.

I also work as a Data & AI consultant and advisor at Accenture. I have over 17 years of experience in research, software engineering, consulting and leadership positions in the industry.

Education/Academic qualification

Language Technology, PhD, Towards Natural Language Understanding: Developing and Assessing Approaches and Benchmarks, University of Helsinki

Mar 2018Mar 2024

Award Date: 19 Mar 2024

Computational Linguistics and Formal Grammar, Master of Science, Path Grammars and the Generative Capacity of Dynamic Syntax, King's College London

20052007

Award Date: 1 Jan 2007

Philosophy, Bachelor of Science, A Limit on Artificial Intelligence?–The Godelian Case, London School of Economics and Political Science

20022005

Award Date: 1 Jul 2005

Fields of Science

  • 6121 Languages
  • Natural Language Processing
  • Language Technology
  • Computational Linguistics
  • Computational Semantics
  • 113 Computer and information sciences
  • Machine Learning

Collaborations and top research areas from the last five years

Recent external collaboration on country/territory level. Dive into details by clicking on the dots or
  • ELOQUENT 2024 — Robustness Task

    Sahlgren, M., Karlgren, J. J., Dürlich, L., Gogoulou, E., Talman, A. & Zahra, S., 2024, Working Notes of the Conference and Labs of the Evaluation Forum (CLEF 2024). Faggioli, G., Ferro, N., Galuščáková, P. & García Seco de Herrera , A. (eds.). Aachen: CEUR-WS.org, p. 703-707 5 p. (CEUR Workshop Proceedings; vol. 3740).

    Research output: Chapter in Book/Report/Conference proceedingConference contributionScientificpeer-review

    Open Access
    File
  • ELOQUENT 2024 - Topical Quiz Task

    Karlgren, J. & Talman, A., 2024, Working Notes of the Conference and Labs of the Evaluation Forum (CLEF 2024). Faggioli, G., Ferro, N., Galuščáková, P. & García Seco de Herrera , A. (eds.). Aachen: CEUR-WS.org, p. 687-690 4 p. (CEUR Workshop Proceedings; vol. 3740).

    Research output: Chapter in Book/Report/Conference proceedingConference contributionScientificpeer-review

    Open Access
    File
  • ELOQUENT CLEF Shared Tasks for Evaluation of Generative Language Model Quality

    Karlgren, J. J., Dürlich, L., Gogoulou, E., Guillou, L., Nivre, J., Sahlgren, M. & Talman, A., 23 Mar 2024, Advances in Information Retrieval. ECIR 2024. Goharian, et al., N. (ed.). Cham: Springer , p. 459–465 ( Lecture Notes in Computer Science; vol. 14612).

    Research output: Chapter in Book/Report/Conference proceedingConference contributionScientificpeer-review

  • Overview of ELOQUENT 2024—Shared Tasks for Evaluating Generative Language Model Quality

    Karlgren, J., Dürlich, L., Gogoulou, E., Guillou, L., Nivre, J., Sahlgren, M., Talman, A. & Zahra, S., 19 Sept 2024, Experimental IR Meets Multilinguality, Multimodality, and Interaction. CLEF 2024. Goeuriot, L., Mulhem, P., Quénot, G., Schwab, D., Di Nunzio, G. M., Soulier, L., Galuščáková, P., García Seco de Herrera, A., Faggioli, G. & Ferro, N. (eds.). Cham: Springer , p. 53-72 20 p. (Lecture Notes in Computer Science; vol. 14959 ).

    Research output: Chapter in Book/Report/Conference proceedingConference contributionScientificpeer-review

  • Overview of the “Voight-Kampff” Generative AI Authorship Verification Task at PAN and ELOQUENT 2024

    Bevendorf, J., Wiegmann, M., Karlgren, J. J., Dürlich, L., Gogoulou, E., Talman, A., Stamatatos, E., Potthast, M. & Stein, B., 2024, Working Notes of the Conference and Labs of the Evaluation Forum (CLEF 2024). Faggioli, G., Ferro, N., Galuščáková, P. & García Seco de Herrera , A. (eds.). Aachen: CEUR-WS.org, p. 2486-2506 21 p. (CEUR Workshop Proceedings; vol. 3740).

    Research output: Chapter in Book/Report/Conference proceedingConference contributionScientificpeer-review

    Open Access
    File