Building blocks for continuous experimentation

Fabian Fagerholm, Alejandro Sanchez Guinea, Hanna Mäenpää, Jürgen Münch

Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingsScientificpeer-review

74 Citations (Scopus)


Development of software-intensive products and services increasingly occurs by continuously deploying product or service increments, such as new features and enhancements, to customers. Product and service developers need to continuously find out what customers want by direct customer feedback and observation of usage behaviour, rather than indirectly through up-front business analyses. This paper examines the preconditions for setting up an experimentation system for continuous customer experiments. It describes the building blocks required for such a system. An initial model for continuous experimentation is analytically derived from prior work. The model is then matched against empirical case study findings from a startup company and adjusted. Building blocks for a continuous experimentation system and infrastructure are presented. A suitable experimentation system requires at least the ability to release minimum viable products or features with suitable instrumentation, design and manage experiment plans, link experiment results with a product roadmap, and manage a flexible business strategy. The main challenges are proper and rapid design of experiments, advanced instrumentation of software to collect, analyse, and store relevant data, and the integration of experiment results in both the product development cycle and the software development process.

Original languageEnglish
Title of host publication1st International Workshop on Rapid Continuous Software Engineering, RCoSE 2014 - Proceedings
Number of pages10
ISBN (Electronic)9781450328562
Publication statusPublished - 3 Jun 2014
MoE publication typeA4 Conference publication
EventInternational Workshop on Rapid Continuous Software Engineering - Hyderabad, India
Duration: 3 Jun 20143 Jun 2014
Conference number: 1


WorkshopInternational Workshop on Rapid Continuous Software Engineering
Abbreviated titleRCoSE


  • Agile Software Development
  • Architecture
  • Continuous Experimentation
  • Lean Software Development
  • Lean Startup
  • Product Development


Dive into the research topics of 'Building blocks for continuous experimentation'. Together they form a unique fingerprint.

Cite this