Dear CAV, We Need to Talk About Reproducibility
This tackles the barrier to scientific progress for the CAV research community by providing domain-specific tools to enhance reproducibility.
The paper addresses the problem of unreliable reproducibility in CAV tool papers by proposing an infrastructure that automates build, unit testing, and benchmarking of research software.
How many times have you tried to re-implement a past CAV tool paper, and failed? Reliably reproducing published scientific discoveries has been acknowledged as a barrier to scientific progress for some time but there remains only a small subset of software available to support the specific needs of the research community (i.e. beyond generic tools such as source code repositories). In this paper we propose an infrastructure for enabling reproducibility in our community, by automating the build, unit testing and benchmarking of research software.