Can Students Review Their Peers?: Comparison of Peer and Instructor Reviews

Forskningsoutput: Kapitel i bok/rapport/konferenshandlingKonferensbidragVetenskapligPeer review


Having students peer review each other's exercises is a common task in modern computing classrooms. In large classes, peer review might even partly replace traditional instructor-led review -- and prior work has found some indications that the quality of peer reviews can be close to that of instructor reviews. In this work, we explore the difference between instructor and peer reviews of student-created programming exercises. One task in an introductory programming course was to have students design their own programming exercises -- including an exercise description, model solution, and test cases -- which were then reviewed by peers. After the course, we had two instructors review the same student-created exercises. We compare the scores given by the instructors and the students to analyze potential differences. Our results suggest that agreement between instructors and students as measured by inter-rater reliability is low, although differences between instructor and student review score distributions are not statistically significant. Additionally, instructors have more fluctuation in their reviews compared to students. Due to the rising popularity of peer reviews, more research is needed to examine to what extent they could complement traditional instructor-led review of exercises.
Titel på värdpublikationITiCSE '22: Proceedings of the 27th ACM Conference on on Innovation and Technology in Computer Science Education Vol. 1
UtgivningsortNew York
Utgivningsdatumjuli 2022
ISBN (elektroniskt)978-1-4503-9201-3
StatusPublicerad - juli 2022
MoE-publikationstypA4 Artikel i en konferenspublikation
EvenemangITiCSE '22: Proceedings of the 27th ACM Conference on on Innovation and Technology in Computer Science Education - Dublin, Irland
Varaktighet: 11 juli 202213 juli 2022
Konferensnummer: 27


  • 113 Data- och informationsvetenskap
  • 516 Pedagogik

Citera det här