The RIGHT Model for Continuous Experimentation

Fabian Fagerholm, Alejandro Sanchez Guinea, Hanna Mäenpää, Jürgen Münch

Research output: Contribution to journalArticleScientificpeer-review

Abstract

Context:Development of software-intensive products and services increasingly occurs by continuously deploying product or service increments, such as new features and enhancements, to customers. Product and service developers must continuously find out what customers want by direct customer feedback and usage behaviour observation. Objective: This paper examines the preconditions for setting up an experimentation system for continuous customer experiments. It describes the RIGHT Model for Continuous Experimentation (Rapid Iterative value creation Gained through High-frequency Testing), illustrating the building blocks required for such a system. Method: An initial model for continuous experimentation is analytically derived from prior work. The model is matched against empirical case study findings from two startup companies and further developed. Results: Building blocks for a continuous experimentation system and infrastructure are presented. Conclusions: A suitable experimentation system requires at least the ability to release minimum viable products or features with suitable instrumentation, design and manage experiment plans, link experiment results with a product roadmap, and manage a flexible business strategy. The main challenges are proper, rapid design of experiments, advanced instrumentation of software to collect, analyse, and store relevant data, and the integration of experiment results in both the product development cycle and the software development process.
Original languageEnglish
JournalThe Journal of Systems and Software
Volume123
Pages (from-to)292-305
Number of pages14
ISSN0164-1212
DOIs
Publication statusPublished - Jan 2017
MoE publication typeA1 Journal article-refereed

Fields of Science

  • 113 Computer and information sciences
  • continuous experimentation
  • product development
  • software architecture
  • software development process
  • agile software development
  • lean software development
  • lean startup
  • customer development

Cite this