Intuitive Analysis of the Quantization-based Optimization: From Stochastic and Quantum Mechanical Perspective
This work addresses the problem of global optimization for researchers and practitioners in fields like machine learning and physics, though it appears incremental as it builds on existing quantization methods with new analytical perspectives.
The paper tackles the challenge of global optimization by analyzing quantization-based optimization, which reduces level sets containing saddle points and local minima to find optimal points, and demonstrates its validity through simulations on benchmark functions.
In this paper, we present an intuitive analysis of the optimization technique based on the quantization of an objective function. Quantization of an objective function is an effective optimization methodology that decreases the measure of a level set containing several saddle points and local minima and finds the optimal point at the limit level set. To investigate the dynamics of quantization-based optimization, we derive an overdamped Langevin dynamics model from an intuitive analysis to minimize the level set by iterative quantization. We claim that quantization-based optimization involves the quantities of thermodynamical and quantum mechanical optimization as the core methodologies of global optimization. Furthermore, on the basis of the proposed SDE, we provide thermodynamic and quantum mechanical analysis with Witten-Laplacian. The simulation results with the benchmark functions, which compare the performance of the nonlinear optimization, demonstrate the validity of the quantization-based optimization.