Analysis of Students' Peer Reviews to Crowdsourced Programming Assignments

Tutkimustuotos: Artikkeli kirjassa/raportissa/konferenssijulkaisussaKonferenssiartikkeliTieteellinenvertaisarvioitu

Kuvaus

We have used a tool called CrowdSorcerer that allows students to create programming assignments. The students are given a topic by a teacher, after which the students design a programming assignment: the assignment description, the code template, a model solution and a set of input-output -tests. The created assignments are peer reviewed by other students on the course. We study students' peer reviews to these student-generated assignments, focusing on examining the differences between novice and experienced programmers. We then analyze whether the exercises created by experienced programmers are rated better quality-wise than those created by novices. Additionally, we investigate the differences between novices and experienced programmers as peer reviewers: can novices review assignments as well as experienced programmers?
Alkuperäiskielienglanti
OtsikkoProceedings of the 18th Koli Calling International Conference on Computing Education Research
KustantajaACM
Julkaisupäivä22 marraskuuta 2018
Artikkeli no21
ISBN (elektroninen)978-1-4503-6535-2
DOI - pysyväislinkit
TilaJulkaistu - 22 marraskuuta 2018
OKM-julkaisutyyppiA4 Artikkeli konferenssijulkaisuussa
Tapahtuma18th Koli Calling International Conference on Computing Education Research - Koli National Park, Lieksa, Suomi
Kesto: 22 marraskuuta 201825 marraskuuta 2018

Tieteenalat

  • 113 Tietojenkäsittely- ja informaatiotieteet

Lainaa tätä

Pirttinen, N., Kangas, V., Nygren, H., Leinonen, J., & Hellas, A. (2018). Analysis of Students' Peer Reviews to Crowdsourced Programming Assignments. teoksessa Proceedings of the 18th Koli Calling International Conference on Computing Education Research [21] ACM. https://doi.org/10.1145/3279720.3279741
Pirttinen, Nea ; Kangas, Vilma ; Nygren, Henrik ; Leinonen, Juho ; Hellas, Arto. / Analysis of Students' Peer Reviews to Crowdsourced Programming Assignments. Proceedings of the 18th Koli Calling International Conference on Computing Education Research. ACM, 2018.
@inproceedings{c726dd939f0b49c4b7bf2e3a981c8f7c,
title = "Analysis of Students' Peer Reviews to Crowdsourced Programming Assignments",
abstract = "We have used a tool called CrowdSorcerer that allows students to create programming assignments. The students are given a topic by a teacher, after which the students design a programming assignment: the assignment description, the code template, a model solution and a set of input-output -tests. The created assignments are peer reviewed by other students on the course. We study students' peer reviews to these student-generated assignments, focusing on examining the differences between novice and experienced programmers. We then analyze whether the exercises created by experienced programmers are rated better quality-wise than those created by novices. Additionally, we investigate the differences between novices and experienced programmers as peer reviewers: can novices review assignments as well as experienced programmers?",
keywords = "113 Computer and information sciences",
author = "Nea Pirttinen and Vilma Kangas and Henrik Nygren and Juho Leinonen and Arto Hellas",
year = "2018",
month = "11",
day = "22",
doi = "10.1145/3279720.3279741",
language = "English",
booktitle = "Proceedings of the 18th Koli Calling International Conference on Computing Education Research",
publisher = "ACM",
address = "International",

}

Pirttinen, N, Kangas, V, Nygren, H, Leinonen, J & Hellas, A 2018, Analysis of Students' Peer Reviews to Crowdsourced Programming Assignments. julkaisussa Proceedings of the 18th Koli Calling International Conference on Computing Education Research., 21, ACM, 18th Koli Calling International Conference on Computing Education Research, Lieksa, Suomi, 22/11/2018. https://doi.org/10.1145/3279720.3279741

Analysis of Students' Peer Reviews to Crowdsourced Programming Assignments. / Pirttinen, Nea; Kangas, Vilma; Nygren, Henrik; Leinonen, Juho; Hellas, Arto.

Proceedings of the 18th Koli Calling International Conference on Computing Education Research. ACM, 2018. 21.

Tutkimustuotos: Artikkeli kirjassa/raportissa/konferenssijulkaisussaKonferenssiartikkeliTieteellinenvertaisarvioitu

TY - GEN

T1 - Analysis of Students' Peer Reviews to Crowdsourced Programming Assignments

AU - Pirttinen, Nea

AU - Kangas, Vilma

AU - Nygren, Henrik

AU - Leinonen, Juho

AU - Hellas, Arto

PY - 2018/11/22

Y1 - 2018/11/22

N2 - We have used a tool called CrowdSorcerer that allows students to create programming assignments. The students are given a topic by a teacher, after which the students design a programming assignment: the assignment description, the code template, a model solution and a set of input-output -tests. The created assignments are peer reviewed by other students on the course. We study students' peer reviews to these student-generated assignments, focusing on examining the differences between novice and experienced programmers. We then analyze whether the exercises created by experienced programmers are rated better quality-wise than those created by novices. Additionally, we investigate the differences between novices and experienced programmers as peer reviewers: can novices review assignments as well as experienced programmers?

AB - We have used a tool called CrowdSorcerer that allows students to create programming assignments. The students are given a topic by a teacher, after which the students design a programming assignment: the assignment description, the code template, a model solution and a set of input-output -tests. The created assignments are peer reviewed by other students on the course. We study students' peer reviews to these student-generated assignments, focusing on examining the differences between novice and experienced programmers. We then analyze whether the exercises created by experienced programmers are rated better quality-wise than those created by novices. Additionally, we investigate the differences between novices and experienced programmers as peer reviewers: can novices review assignments as well as experienced programmers?

KW - 113 Computer and information sciences

U2 - 10.1145/3279720.3279741

DO - 10.1145/3279720.3279741

M3 - Conference contribution

BT - Proceedings of the 18th Koli Calling International Conference on Computing Education Research

PB - ACM

ER -

Pirttinen N, Kangas V, Nygren H, Leinonen J, Hellas A. Analysis of Students' Peer Reviews to Crowdsourced Programming Assignments. julkaisussa Proceedings of the 18th Koli Calling International Conference on Computing Education Research. ACM. 2018. 21 https://doi.org/10.1145/3279720.3279741