The Vizier Gaussian Process Bandit Algorithm
This work provides an incremental improvement to a widely used optimization tool for researchers and practitioners, enhancing its performance in practical applications.
The paper presents the implementation and design of the default algorithm in Open Source Vizier, a Bayesian optimization service, showing its robustness and versatility against industry baselines on standardized benchmarks.
Google Vizier has performed millions of optimizations and accelerated numerous research and production systems at Google, demonstrating the success of Bayesian optimization as a large-scale service. Over multiple years, its algorithm has been improved considerably, through the collective experiences of numerous research efforts and user feedback. In this technical report, we discuss the implementation details and design choices of the current default algorithm provided by Open Source Vizier. Our experiments on standardized benchmarks reveal its robustness and versatility against well-established industry baselines on multiple practical modes.