Local Energy Distribution Based Hyperparameter Determination for Stochastic Simulated Annealing
This work addresses the hyperparameter tuning bottleneck for researchers and practitioners using SSA in combinatorial optimization, representing an incremental improvement.
The paper tackles the time-consuming hyperparameter search in stochastic simulated annealing (SSA) by proposing a method that uses local energy distributions to determine hyperparameters, reducing search complexity from O(n^3) to O(1) and achieving mean cut values of about 98% of best-known values on maximum-cut benchmarks.
This paper presents a local energy distribution based hyperparameter determination for stochastic simulated annealing (SSA). SSA is capable of solving combinatorial optimization problems faster than typical simulated annealing (SA), but requires a time-consuming hyperparameter search. The proposed method determines hyperparameters based on the local energy distributions of spins (probabilistic bits). The spin is a basic computing element of SSA and is graphically connected to other spins with its weights. The distribution of the local energy can be estimated based on the central limit theorem (CLT). The CLT-based normal distribution is used to determine the hyperparameters, which reduces the time complexity for hyperparameter search from O(n^3) of the conventional method to O(1). The performance of SSA with the determined hyperparameters is evaluated on the Gset and K2000 benchmarks for maximum-cut problems. The results show that the proposed method achieves mean cut values of approximately 98% of the best-known cut values.