The RIGHT Model for Continuous Experimentation

Fabian Fagerholm, Alejandro Sanchez Guinea, Hanna Mäenpää, Jürgen Münch

Tutkimustuotos: ArtikkelijulkaisuArtikkeliTieteellinenvertaisarvioitu

Kuvaus

Context:Development of software-intensive products and services increasingly occurs by continuously deploying product or service increments, such as new features and enhancements, to customers. Product and service developers must continuously find out what customers want by direct customer feedback and usage behaviour observation. Objective: This paper examines the preconditions for setting up an experimentation system for continuous customer experiments. It describes the RIGHT Model for Continuous Experimentation (Rapid Iterative value creation Gained through High-frequency Testing), illustrating the building blocks required for such a system. Method: An initial model for continuous experimentation is analytically derived from prior work. The model is matched against empirical case study findings from two startup companies and further developed. Results: Building blocks for a continuous experimentation system and infrastructure are presented. Conclusions: A suitable experimentation system requires at least the ability to release minimum viable products or features with suitable instrumentation, design and manage experiment plans, link experiment results with a product roadmap, and manage a flexible business strategy. The main challenges are proper, rapid design of experiments, advanced instrumentation of software to collect, analyse, and store relevant data, and the integration of experiment results in both the product development cycle and the software development process.
Alkuperäiskielienglanti
LehtiThe Journal of Systems and Software
Vuosikerta123
Sivut292-305
Sivumäärä14
ISSN0164-1212
DOI - pysyväislinkit
TilaJulkaistu - tammikuuta 2017
OKM-julkaisutyyppiA1 Alkuperäisartikkeli tieteellisessä aikakauslehdessä, vertaisarvioitu

Tieteenalat

  • 113 Tietojenkäsittely- ja informaatiotieteet

Lainaa tätä

Fagerholm, Fabian ; Sanchez Guinea, Alejandro ; Mäenpää, Hanna ; Münch, Jürgen. / The RIGHT Model for Continuous Experimentation. Julkaisussa: The Journal of Systems and Software. 2017 ; Vuosikerta 123. Sivut 292-305.
@article{98ea76af71f5440d9096e104f89a0cee,
title = "The RIGHT Model for Continuous Experimentation",
abstract = "Context:Development of software-intensive products and services increasingly occurs by continuously deploying product or service increments, such as new features and enhancements, to customers. Product and service developers must continuously find out what customers want by direct customer feedback and usage behaviour observation. Objective: This paper examines the preconditions for setting up an experimentation system for continuous customer experiments. It describes the RIGHT Model for Continuous Experimentation (Rapid Iterative value creation Gained through High-frequency Testing), illustrating the building blocks required for such a system. Method: An initial model for continuous experimentation is analytically derived from prior work. The model is matched against empirical case study findings from two startup companies and further developed. Results: Building blocks for a continuous experimentation system and infrastructure are presented. Conclusions: A suitable experimentation system requires at least the ability to release minimum viable products or features with suitable instrumentation, design and manage experiment plans, link experiment results with a product roadmap, and manage a flexible business strategy. The main challenges are proper, rapid design of experiments, advanced instrumentation of software to collect, analyse, and store relevant data, and the integration of experiment results in both the product development cycle and the software development process.",
keywords = "113 Computer and information sciences, continuous experimentation, product development, software architecture, software development process, agile software development, lean software development, lean startup, customer development",
author = "Fabian Fagerholm and {Sanchez Guinea}, Alejandro and Hanna M{\"a}enp{\"a}{\"a} and J{\"u}rgen M{\"u}nch",
year = "2017",
month = "1",
doi = "10.1016/j.jss.2016.03.034",
language = "English",
volume = "123",
pages = "292--305",
journal = "The Journal of Systems and Software",
issn = "0164-1212",
publisher = "Elsevier Scientific Publ. Co",

}

The RIGHT Model for Continuous Experimentation. / Fagerholm, Fabian; Sanchez Guinea, Alejandro; Mäenpää, Hanna; Münch, Jürgen.

julkaisussa: The Journal of Systems and Software, Vuosikerta 123, 01.2017, s. 292-305.

Tutkimustuotos: ArtikkelijulkaisuArtikkeliTieteellinenvertaisarvioitu

TY - JOUR

T1 - The RIGHT Model for Continuous Experimentation

AU - Fagerholm, Fabian

AU - Sanchez Guinea, Alejandro

AU - Mäenpää, Hanna

AU - Münch, Jürgen

PY - 2017/1

Y1 - 2017/1

N2 - Context:Development of software-intensive products and services increasingly occurs by continuously deploying product or service increments, such as new features and enhancements, to customers. Product and service developers must continuously find out what customers want by direct customer feedback and usage behaviour observation. Objective: This paper examines the preconditions for setting up an experimentation system for continuous customer experiments. It describes the RIGHT Model for Continuous Experimentation (Rapid Iterative value creation Gained through High-frequency Testing), illustrating the building blocks required for such a system. Method: An initial model for continuous experimentation is analytically derived from prior work. The model is matched against empirical case study findings from two startup companies and further developed. Results: Building blocks for a continuous experimentation system and infrastructure are presented. Conclusions: A suitable experimentation system requires at least the ability to release minimum viable products or features with suitable instrumentation, design and manage experiment plans, link experiment results with a product roadmap, and manage a flexible business strategy. The main challenges are proper, rapid design of experiments, advanced instrumentation of software to collect, analyse, and store relevant data, and the integration of experiment results in both the product development cycle and the software development process.

AB - Context:Development of software-intensive products and services increasingly occurs by continuously deploying product or service increments, such as new features and enhancements, to customers. Product and service developers must continuously find out what customers want by direct customer feedback and usage behaviour observation. Objective: This paper examines the preconditions for setting up an experimentation system for continuous customer experiments. It describes the RIGHT Model for Continuous Experimentation (Rapid Iterative value creation Gained through High-frequency Testing), illustrating the building blocks required for such a system. Method: An initial model for continuous experimentation is analytically derived from prior work. The model is matched against empirical case study findings from two startup companies and further developed. Results: Building blocks for a continuous experimentation system and infrastructure are presented. Conclusions: A suitable experimentation system requires at least the ability to release minimum viable products or features with suitable instrumentation, design and manage experiment plans, link experiment results with a product roadmap, and manage a flexible business strategy. The main challenges are proper, rapid design of experiments, advanced instrumentation of software to collect, analyse, and store relevant data, and the integration of experiment results in both the product development cycle and the software development process.

KW - 113 Computer and information sciences

KW - continuous experimentation

KW - product development

KW - software architecture

KW - software development process

KW - agile software development

KW - lean software development

KW - lean startup

KW - customer development

U2 - 10.1016/j.jss.2016.03.034

DO - 10.1016/j.jss.2016.03.034

M3 - Article

VL - 123

SP - 292

EP - 305

JO - The Journal of Systems and Software

JF - The Journal of Systems and Software

SN - 0164-1212

ER -