Crowdsourcing Programming Assignments with CrowdSorcerer

Nea Pirttinen, Vilma Kangas, Irene Nikkarinen, Henrik Nygren, Juho Leinonen, Arto Hellas

Research output: Chapter in Book/Report/Conference proceedingConference contributionScientificpeer-review


Small automatically assessed programming assignments are an often used resource for learning programming. Creating sufficiently large amounts of such assignments is, however, time consuming. As a consequence, offering large quantities of practice assignments to students is not always possible. CrowdSorcerer is an embeddable open-source system that students and teachers alike can use for creating and evaluating small automatically assessed programming assignments. While creating programming assignments, the students also write simple input-output -tests, and are gently introduced to the basics of testing. Students can also evaluate the assignments of others and provide feedback on them, which exposes them to code written by others early in their education. In this article we both describe the CrowdSorcerer system and our experiences in using the system in a large undergraduate programming course. Moreover, we discuss the motivation for crowdsourcing course assignments and present some usage statistics.
Original languageEnglish
Title of host publicationProceedings of the 23rd Annual ACM Conference on Innovation and Technology in Computer Science Education
Number of pages6
Place of PublicationNew York, NY
Publication date2 Jul 2018
ISBN (Electronic)978-1-4503-5707-4
Publication statusPublished - 2 Jul 2018
MoE publication typeA4 Article in conference proceedings
Event23rd Annual Conference on Innovation and Technology in Computer Science Education (ITiCSE 2018) - University of Central Lancashire, Cyprus, Larnaca, Cyprus
Duration: 2 Jul 20184 Jul 2018
Conference number: 23

Fields of Science

  • 113 Computer and information sciences

Cite this