Global Benchmark Database
This provides infrastructure for empirical research in computational domains, though it is incremental as it builds on existing benchmark management concepts.
The paper introduces Global Benchmark Database (GBD), a comprehensive suite of tools for provisioning and maintaining benchmark instances and their metadata to support tasks like data-driven benchmark compilation and solver selection.
This paper presents Global Benchmark Database (GBD), a comprehensive suite of tools for provisioning and sustainably maintaining benchmark instances and their metadata. The availability of benchmark metadata is essential for many tasks in empirical research, e.g., for the data-driven compilation of benchmarks, the domain-specific analysis of runtime experiments, or the instance-specific selection of solvers. In this paper, we introduce the data model of GBD as well as its interfaces and provide examples of how to interact with them. We also demonstrate the integration of custom data sources and explain how to extend GBD with additional problem domains, instance formats and feature extractors.