LGAIDec 8, 2021

Hyper-parameter optimization based on soft actor critic and hierarchical mixture regularization

arXiv:2112.04084v1
AI Analysis

This addresses the problem of efficient hyper-parameter tuning for machine learning practitioners, but it appears incremental as it builds on existing reinforcement learning methods.

The paper tackles hyper-parameter optimization by modeling it as a Markov decision process and using reinforcement learning with soft actor critic and hierarchical mixture regularization, resulting in better hyper-parameters obtained in a shorter time.

Hyper-parameter optimization is a crucial problem in machine learning as it aims to achieve the state-of-the-art performance in any model. Great efforts have been made in this field, such as random search, grid search, Bayesian optimization. In this paper, we model hyper-parameter optimization process as a Markov decision process, and tackle it with reinforcement learning. A novel hyper-parameter optimization method based on soft actor critic and hierarchical mixture regularization has been proposed. Experiments show that the proposed method can obtain better hyper-parameters in a shorter time.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes