The Fundamental Principles of Reproducibility
This paper addresses the problem of confused terminology in reproducibility for researchers across scientific disciplines, aiming to provide a clearer framework.
This paper clarifies the terminology surrounding reproducibility by rooting it in the scientific method. It defines reproducibility, specifies three types, and outlines four degrees of reproducibility, exemplified with machine learning.
Reproducibility is a confused terminology. In this paper, I take a fundamental view on reproducibility rooted in the scientific method. The scientific method is analysed and characterised in order to develop the terminology required to define reproducibility. Further, the literature on reproducibility and replication is surveyed, and experiments are modeled as tasks and problem solving methods. Machine learning is used to exemplify the described approach. Based on the analysis, reproducibility is defined and three different types of reproducibility as well as four degrees of reproducibility are specified.