mlr3mbo: Bayesian Optimization in R
This provides a comprehensive software solution for researchers and practitioners in machine learning and optimization, though it is incremental as it builds on existing Bayesian optimization methods.
The authors tackled the problem of Bayesian optimization in R by developing mlr3mbo, a modular toolbox that supports various optimization features and achieves state-of-the-art performance, as demonstrated in benchmarks against optimizers like HEBO, SMAC3, Ax, and Optuna.
We present mlr3mbo, a comprehensive and modular toolbox for Bayesian optimization in R. mlr3mbo supports single- and multi-objective optimization, multi-point proposals, batch and asynchronous parallelization, input and output transformations, and robust error handling. While it can be used for many standard Bayesian optimization variants in applied settings, researchers can also construct custom BO algorithms from its flexible building blocks. In addition to an introduction to the software, its design principles, and its building blocks, the paper presents two extensive empirical evaluations of the software on the surrogate-based benchmark suite YAHPO Gym. To identify robust default configurations for both numeric and mixed-hierarchical optimization regimes, and to gain further insights into the respective impacts of individual settings, we run a coordinate descent search over the mlr3mbo configuration space and analyze its results. Furthermore, we demonstrate that mlr3mbo achieves state-of-the-art performance by benchmarking it against a wide range of optimizers, including HEBO, SMAC3, Ax, and Optuna.