Thursday, 30th of January 2020, 12:00 – 1:00

Reliable Online Controlled Experiments as a new Paradigm for Automated Software Quality Assurance

SR1, ICT Building,
Technikerstraße 21a, 6020 Innsbruck

Florian Auer
Researcher at QE group, University of Innsbruck


  The systematic and continuously execution of experiments to assess the return-on-investment of potential software features became known under the term “continuous experimentation”. It removed the guesswork and expensive evaluation of future features. In addition to its current application on feature evaluation it has the potential to be usable for areas of software engineering in which traditional testing techniques are no longer sufficient.  This includes areas like machine learning algorithms or internet of things. Thus, it represents a novel software quality assurance technique. Although, experience reports and guidelines to avoid common pitfalls exist in literature, the fundamental characteristics of an experiment for quality assurance are not researched sufficiently. Therefore, we researched about the characteristics of experiments with the goal to create a model that gives an overview on all characteristics that need to be considered for a reliable online controlled experiment. It will form the basis for a more structured experiment definition, static experiment testing, software quality assurance and many more.


Nach oben scrollen