Continuous Experimentation in Mobile Game Development

Sezin Yaman, Tommi Mikkonen, Riku Suomela

Research output: Chapter in Book/Report/Conference proceedingConference contributionScientificpeer-review


Software companies need capabilities to evaluate the user value and the success of their products. This is especially crucial for highly competitive markets, such as the mobile game industry, where thousands of new games are introduced every month. Game companies often run continuous experiments as an integrated part of the overall development process. This paper presents a game company’s journey on experimentation, and describes how the experiments are used at different stages of the development cycle to produce reliable, meaningful data for developers as well as how to balance between different data collection methods. Our study indicates that experiments are important in all stages of the development in different forms. Early stages in the development experiments can be run with proxy users due to lack of real users, whereas later in the development Key Performance Indicator (KPI) metrics play the most important role in experiments. Establishing concrete goals for the experiments, balancing between qualitative and quantitative data collection, experimentation throughout the development process with the guidance of an efficient leadership appears to be the key to success.
Original languageEnglish
Title of host publication44th Euromicro Conference on Software Engineering and Advanced Applications (SEEA 2018)
EditorsT. Bures, L. Angelis
Number of pages8
Publication date29 Aug 2018
ISBN (Print)978-1-5386-7384-3
ISBN (Electronic)978-1-5386-7383-6
Publication statusPublished - 29 Aug 2018
MoE publication typeA4 Article in conference proceedings
EventEuromicro Conference on Software Engineering and Advanced Applications (SEAA 2018) - Prague, Prague , Czech Republic
Duration: 29 Aug 201831 Aug 2018
Conference number: 44

Publication series

NameEUROMICRO Conference Proceedings
ISSN (Print)1089-6503

Fields of Science

  • 113 Computer and information sciences
  • Continuous experimentation
  • experiment-driven software development
  • product management
  • customer development
  • customer involvement
  • organisational transition
  • agile software development

Cite this