Reproducibility Report for the Paper: QN-based Modeling and Analysis of Software Performance Antipatterns for Cyber-Physical Systems
This addresses the issue of research reproducibility for researchers in software engineering and cyber-physical systems, but it is incremental as it focuses on evaluating an existing artifact rather than introducing new methods or findings.
The authors tackled the problem of ensuring reproducibility in research by evaluating an artifact for a paper on QN-based modeling and analysis of software performance antipatterns for cyber-physical systems, and the result was that all experiments, figures, and tables were successfully reproduced, earning three badges for artifact availability, functionality, and result reproduction.
The authors have uploaded their artifact to Zenodo, which ensures a long-term retention of the artifact. The artifact allows to re-run the experiments very smoothly, and the dependencies are well documented. The process to regenerate data for the figures and tables in the paper completes, and all results are reproducible. This paper can thus receive the Artifacts Available badge. The software in the artifact runs correctly with no trouble, and is relevant to the paper, thus deserving the Artifacts Evaluated -- Functional badge. Given the successful reproduction of all figures and tables, the Results Reproduced badge can be assigned.