Parameterized Convex Minorant for Objective Function Approximation in Amortized Optimization
This work addresses the challenge of efficiently finding global minima in optimization problems, particularly for learning-based control, but it appears incremental as it builds on existing convex optimization techniques.
The paper tackles the problem of approximating objective functions in amortized optimization by proposing a parameterized convex minorant method, which ensures that the global minimizer can be found reliably and quickly through convex optimization, as demonstrated in simulations for non-convex function approximation and nonlinear model predictive control.
Parameterized convex minorant (PCM) method is proposed for the approximation of the objective function in amortized optimization. In the proposed method, the objective function approximator is expressed by the sum of a PCM and a nonnegative gap function, where the objective function approximator is bounded from below by the PCM convex in the optimization variable. The proposed objective function approximator is a universal approximator for continuous functions, and the global minimizer of the PCM attains the global minimum of the objective function approximator. Therefore, the global minimizer of the objective function approximator can be obtained by a single convex optimization. As a realization of the proposed method, extended parameterized log-sum-exp network is proposed by utilizing a parameterized log-sum-exp network as the PCM. Numerical simulation is performed for parameterized non-convex objective function approximation and for learning-based nonlinear model predictive control to demonstrate the performance and characteristics of the proposed method. The simulation results support that the proposed method can be used to learn objective functions and to find a global minimizer reliably and quickly by using convex optimization algorithms.