A Study of Keystroke Data in Two Contexts: Written Language and Programming Language Influence Predictability of Learning Outcomes

John Edwards, Juho Leinonen, Arto Hellas

Research output: Chapter in Book/Report/Conference proceedingConference contributionScientificpeer-review

Abstract

We study programming process data from two introductory programming courses. Between the course contexts, the programming languages differ, the teaching approaches differ, and the spoken languages differ. In both courses, students' keystroke data -- timestamps and the pressed keys -- are recorded as students work on programming assignments. We study how the keystroke data differs between the contexts, and whether research on predicting course outcomes using keystroke latencies generalizes to other contexts. Our results show that there are differences between the contexts in terms of frequently used keys, which can be partially explained by the differences between the spoken languages and the programming languages. Further, our results suggest that programming process data that can be collected non-intrusive in-situ can be used for predicting course outcomes in multiple contexts. The predictive power, however, varies between contexts possibly because the frequently used keys differ between programming languages and spoken languages. Thus, context-specific fine-tuning of predictive models may be needed.
Original languageEnglish
Title of host publicationSIGCSE '20: Proceedings of the 51st ACM Technical Symposium on Computer Science Education
Number of pages7
PublisherACM
Publication date26 Feb 2020
Pages413-419
DOIs
Publication statusPublished - 26 Feb 2020
MoE publication typeA4 Article in conference proceedings
EventSIGCSE 2020 - Portland, United States
Duration: 11 Mar 202014 Mar 2020
https://sigcse2020.sigcse.org/

Fields of Science

  • 113 Computer and information sciences
  • 516 Educational sciences

Cite this

Edwards, J., Leinonen, J., & Hellas, A. (2020). A Study of Keystroke Data in Two Contexts: Written Language and Programming Language Influence Predictability of Learning Outcomes. In SIGCSE '20: Proceedings of the 51st ACM Technical Symposium on Computer Science Education (pp. 413-419). ACM. https://doi.org/10.1145/3328778.3366863