Hyperparameter Optimization of Constraint Programming Solvers
This work addresses the challenge of optimizing solver performance for constraint programming users, offering a practical, resource-aware tuning method that yields robust improvements, though it is incremental as it builds on existing hyperparameter optimization techniques.
The paper tackles the problem of hyperparameter tuning for constraint programming solvers, which is difficult and time-consuming, by introducing a two-phase framework called probe and solve algorithm. Results show that using Bayesian optimization within this framework improves solution quality for ACE in 25.4% of instances and for Choco in 38.6% of instances compared to default configurations.
The performance of constraint programming solvers is highly sensitive to the choice of their hyperparameters. Manually finding the best solver configuration is a difficult, time-consuming task that typically requires expert knowledge. In this paper, we introduce probe and solve algorithm, a novel two-phase framework for automated hyperparameter optimization integrated into the CPMpy library. This approach partitions the available time budget into two phases: a probing phase that explores different sets of hyperparameters using configurable hyperparameter optimization methods, followed by a solving phase where the best configuration found is used to tackle the problem within the remaining time. We implement and compare two hyperparameter optimization methods within the probe and solve algorithm: Bayesian optimization and Hamming distance search. We evaluate the algorithm on two different constraint programming solvers, ACE and Choco, across 114 combinatorial problem instances, comparing their performance against the solver's default configurations. Results show that using Bayesian optimization, the algorithm outperforms the solver's default configurations, improving solution quality for ACE in 25.4% of instances and matching the default performance in 57.9%, and for Choco, achieving superior results in 38.6% of instances. It also consistently surpasses Hamming distance search within the same framework, confirming the advantage of model-based exploration over simple local search. Overall, the probe and solve algorithm offers a practical, resource-aware approach for tuning constraint solvers that yields robust improvements across diverse problem types.