Transitioning towards continuous experimentation in a large software product and service development organisation – A case study

Sezin Gizem Yaman, Fabian Fagerholm, Myriam Munezero, Jürgen Münch, Mika Aaltola, Christina Palmu, Tomi Männistö

Tutkimustuotos: Artikkeli kirjassa/raportissa/konferenssijulkaisussaKonferenssiartikkeliTieteellinenvertaisarvioitu

Kuvaus

Context: Companies need capabilities to evaluate the customer value of software-intensive products and services. One way of systematically acquiring data on customer value is running continuous experiments as part of the overall development process. Objective: This paper investigates the first steps of transitioning towards continuous experimentation in a large company, including the challenges faced. Method: We conduct a single-case study using participant observation, interviews, and qualitative analysis of the collected data. Results: Results show that continuous experimentation was well received by the practitioners and practicing experimentation helped them to enhance understanding of their product value and user needs. Although the complexities of a large multi-stakeholder business-to-business (B2B) environment presented several challenges such as inaccessible users, it was possible to address impediments and integrate an experiment in an ongoing development project. Conclusion: Developing the capability for continuous experimentation in large organisations is a learning process which can be supported by a systematic introduction approach with the guidance of experts. We gained experience by introducing the approach on a small scale in a large organisation, and one of the major steps for future work is to understand how this can be scaled up to the whole development organisation.
Alkuperäiskielienglanti
OtsikkoProduct-Focused Software Process Improvement : 17th International Conference, PROFES 2016 Trondheim, Norway, November 22–24, 2016 Proceedings
ToimittajatPekka Abrahamsson, Andreas Jedlitschka, Anh Nguyen Duc, Michael Felderer, Sousuke Amasaki, Tommi Mikkonen
Sivumäärä16
JulkaisupaikkaCham
Kustantaja Springer International Publishing AG
Julkaisupäivä6 marraskuuta 2016
Sivut344-359
ISBN (painettu)978-3-319-49093-9
ISBN (elektroninen)978-3-319-49094-6
DOI - pysyväislinkit
TilaJulkaistu - 6 marraskuuta 2016
OKM-julkaisutyyppiA4 Artikkeli konferenssijulkaisuussa
TapahtumaInternational Conference on Product-Focused Software Process Improvement - Trondheim, Norja
Kesto: 22 marraskuuta 201624 marraskuuta 2016
Konferenssinumero: 17

Julkaisusarja

NimiLecture Notes in Computer Science
KustantajaSpringer International Publishing AG
Vuosikerta10027
ISSN (painettu)0302-9743
ISSN (elektroninen)1611-3349

Lisätietoja


Volume:
Proceeding volume:

Tieteenalat

  • 113 Tietojenkäsittely- ja informaatiotieteet

Lainaa tätä

Yaman, S. G., Fagerholm, F., Munezero, M., Münch, J., Aaltola, M., Palmu, C., & Männistö, T. (2016). Transitioning towards continuous experimentation in a large software product and service development organisation – A case study. teoksessa P. Abrahamsson, A. Jedlitschka, A. N. Duc, M. Felderer, S. Amasaki, & T. Mikkonen (Toimittajat), Product-Focused Software Process Improvement: 17th International Conference, PROFES 2016 Trondheim, Norway, November 22–24, 2016 Proceedings (Sivut 344-359). (Lecture Notes in Computer Science; Vuosikerta 10027). Cham: Springer International Publishing AG. https://doi.org/10.1007/978-3-319-49094-6_22
Yaman, Sezin Gizem ; Fagerholm, Fabian ; Munezero, Myriam ; Münch, Jürgen ; Aaltola, Mika ; Palmu, Christina ; Männistö, Tomi. / Transitioning towards continuous experimentation in a large software product and service development organisation – A case study. Product-Focused Software Process Improvement: 17th International Conference, PROFES 2016 Trondheim, Norway, November 22–24, 2016 Proceedings. Toimittaja / Pekka Abrahamsson ; Andreas Jedlitschka ; Anh Nguyen Duc ; Michael Felderer ; Sousuke Amasaki ; Tommi Mikkonen. Cham : Springer International Publishing AG, 2016. Sivut 344-359 (Lecture Notes in Computer Science).
@inproceedings{30746fe6a2744f9bbfee609e97b1173f,
title = "Transitioning towards continuous experimentation in a large software product and service development organisation – A case study",
abstract = "Context: Companies need capabilities to evaluate the customer value of software-intensive products and services. One way of systematically acquiring data on customer value is running continuous experiments as part of the overall development process. Objective: This paper investigates the first steps of transitioning towards continuous experimentation in a large company, including the challenges faced. Method: We conduct a single-case study using participant observation, interviews, and qualitative analysis of the collected data. Results: Results show that continuous experimentation was well received by the practitioners and practicing experimentation helped them to enhance understanding of their product value and user needs. Although the complexities of a large multi-stakeholder business-to-business (B2B) environment presented several challenges such as inaccessible users, it was possible to address impediments and integrate an experiment in an ongoing development project. Conclusion: Developing the capability for continuous experimentation in large organisations is a learning process which can be supported by a systematic introduction approach with the guidance of experts. We gained experience by introducing the approach on a small scale in a large organisation, and one of the major steps for future work is to understand how this can be scaled up to the whole development organisation.",
keywords = "113 Computer and information sciences, Continuous experimentation, Experiment-driven software development, Product management, Lean startup, Customer development, Customer involvement, Organisational transition, Agile software development, Case study",
author = "Yaman, {Sezin Gizem} and Fabian Fagerholm and Myriam Munezero and J{\"u}rgen M{\"u}nch and Mika Aaltola and Christina Palmu and Tomi M{\"a}nnist{\"o}",
note = "Volume: Proceeding volume:",
year = "2016",
month = "11",
day = "6",
doi = "10.1007/978-3-319-49094-6_22",
language = "English",
isbn = "978-3-319-49093-9",
series = "Lecture Notes in Computer Science",
publisher = "Springer International Publishing AG",
pages = "344--359",
editor = "Pekka Abrahamsson and Andreas Jedlitschka and Duc, {Anh Nguyen} and Michael Felderer and Sousuke Amasaki and Tommi Mikkonen",
booktitle = "Product-Focused Software Process Improvement",
address = "Switzerland",

}

Yaman, SG, Fagerholm, F, Munezero, M, Münch, J, Aaltola, M, Palmu, C & Männistö, T 2016, Transitioning towards continuous experimentation in a large software product and service development organisation – A case study. julkaisussa P Abrahamsson, A Jedlitschka, AN Duc, M Felderer, S Amasaki & T Mikkonen (toim), Product-Focused Software Process Improvement: 17th International Conference, PROFES 2016 Trondheim, Norway, November 22–24, 2016 Proceedings. Lecture Notes in Computer Science, Vuosikerta 10027, Springer International Publishing AG, Cham, Sivut 344-359, International Conference on Product-Focused Software Process Improvement, Trondheim, Norja, 22/11/2016. https://doi.org/10.1007/978-3-319-49094-6_22

Transitioning towards continuous experimentation in a large software product and service development organisation – A case study. / Yaman, Sezin Gizem; Fagerholm, Fabian; Munezero, Myriam; Münch, Jürgen; Aaltola, Mika; Palmu, Christina; Männistö, Tomi.

Product-Focused Software Process Improvement: 17th International Conference, PROFES 2016 Trondheim, Norway, November 22–24, 2016 Proceedings. toim. / Pekka Abrahamsson; Andreas Jedlitschka; Anh Nguyen Duc; Michael Felderer; Sousuke Amasaki; Tommi Mikkonen. Cham : Springer International Publishing AG, 2016. s. 344-359 (Lecture Notes in Computer Science; Vuosikerta 10027).

Tutkimustuotos: Artikkeli kirjassa/raportissa/konferenssijulkaisussaKonferenssiartikkeliTieteellinenvertaisarvioitu

TY - GEN

T1 - Transitioning towards continuous experimentation in a large software product and service development organisation – A case study

AU - Yaman, Sezin Gizem

AU - Fagerholm, Fabian

AU - Munezero, Myriam

AU - Münch, Jürgen

AU - Aaltola, Mika

AU - Palmu, Christina

AU - Männistö, Tomi

N1 - Volume: Proceeding volume:

PY - 2016/11/6

Y1 - 2016/11/6

N2 - Context: Companies need capabilities to evaluate the customer value of software-intensive products and services. One way of systematically acquiring data on customer value is running continuous experiments as part of the overall development process. Objective: This paper investigates the first steps of transitioning towards continuous experimentation in a large company, including the challenges faced. Method: We conduct a single-case study using participant observation, interviews, and qualitative analysis of the collected data. Results: Results show that continuous experimentation was well received by the practitioners and practicing experimentation helped them to enhance understanding of their product value and user needs. Although the complexities of a large multi-stakeholder business-to-business (B2B) environment presented several challenges such as inaccessible users, it was possible to address impediments and integrate an experiment in an ongoing development project. Conclusion: Developing the capability for continuous experimentation in large organisations is a learning process which can be supported by a systematic introduction approach with the guidance of experts. We gained experience by introducing the approach on a small scale in a large organisation, and one of the major steps for future work is to understand how this can be scaled up to the whole development organisation.

AB - Context: Companies need capabilities to evaluate the customer value of software-intensive products and services. One way of systematically acquiring data on customer value is running continuous experiments as part of the overall development process. Objective: This paper investigates the first steps of transitioning towards continuous experimentation in a large company, including the challenges faced. Method: We conduct a single-case study using participant observation, interviews, and qualitative analysis of the collected data. Results: Results show that continuous experimentation was well received by the practitioners and practicing experimentation helped them to enhance understanding of their product value and user needs. Although the complexities of a large multi-stakeholder business-to-business (B2B) environment presented several challenges such as inaccessible users, it was possible to address impediments and integrate an experiment in an ongoing development project. Conclusion: Developing the capability for continuous experimentation in large organisations is a learning process which can be supported by a systematic introduction approach with the guidance of experts. We gained experience by introducing the approach on a small scale in a large organisation, and one of the major steps for future work is to understand how this can be scaled up to the whole development organisation.

KW - 113 Computer and information sciences

KW - Continuous experimentation

KW - Experiment-driven software development

KW - Product management

KW - Lean startup

KW - Customer development

KW - Customer involvement

KW - Organisational transition

KW - Agile software development

KW - Case study

U2 - 10.1007/978-3-319-49094-6_22

DO - 10.1007/978-3-319-49094-6_22

M3 - Conference contribution

SN - 978-3-319-49093-9

T3 - Lecture Notes in Computer Science

SP - 344

EP - 359

BT - Product-Focused Software Process Improvement

A2 - Abrahamsson, Pekka

A2 - Jedlitschka, Andreas

A2 - Duc, Anh Nguyen

A2 - Felderer, Michael

A2 - Amasaki, Sousuke

A2 - Mikkonen, Tommi

PB - Springer International Publishing AG

CY - Cham

ER -

Yaman SG, Fagerholm F, Munezero M, Münch J, Aaltola M, Palmu C et al. Transitioning towards continuous experimentation in a large software product and service development organisation – A case study. julkaisussa Abrahamsson P, Jedlitschka A, Duc AN, Felderer M, Amasaki S, Mikkonen T, toimittajat, Product-Focused Software Process Improvement: 17th International Conference, PROFES 2016 Trondheim, Norway, November 22–24, 2016 Proceedings. Cham: Springer International Publishing AG. 2016. s. 344-359. (Lecture Notes in Computer Science). https://doi.org/10.1007/978-3-319-49094-6_22