A Nearly Optimal Single Loop Algorithm for Stochastic Bilevel Optimization under Unbounded Smoothness
It addresses the impractical nested-loop design in bilevel optimization for applications like meta-learning with sequential data, offering a more efficient and tunable solution.
The paper tackles stochastic bilevel optimization with nonconvex upper-level functions and strongly convex lower-level functions, proposing a single-loop algorithm (SLIP) that achieves an $\epsilon$-stationary point with $\widetilde{O}(1/\epsilon^4)$ oracle calls, nearly optimal without mean-square smoothness, and outperforms baselines in experiments.
This paper studies the problem of stochastic bilevel optimization where the upper-level function is nonconvex with potentially unbounded smoothness and the lower-level function is strongly convex. This problem is motivated by meta-learning applied to sequential data, such as text classification using recurrent neural networks, where the smoothness constant of the upper-level loss function scales linearly with the gradient norm and can be potentially unbounded. Existing algorithm crucially relies on the nested loop design, which requires significant tuning efforts and is not practical. In this paper, we address this issue by proposing a Single Loop bIlevel oPtimizer (SLIP). The proposed algorithm first updates the lower-level variable by a few steps of stochastic gradient descent, and then simultaneously updates the upper-level variable by normalized stochastic gradient descent with momentum and the lower-level variable by stochastic gradient descent. Under standard assumptions, we show that our algorithm finds an $ε$-stationary point within $\widetilde{O}(1/ε^4)$\footnote{Here $\widetilde{O}(\cdot)$ compresses logarithmic factors of $1/ε$ and $1/δ$, where $δ\in(0,1)$ denotes the failure probability.} oracle calls of stochastic gradient or Hessian-vector product, both in expectation and with high probability. This complexity result is nearly optimal up to logarithmic factors without mean-square smoothness of the stochastic gradient oracle. Our proof relies on (i) a refined characterization and control of the lower-level variable and (ii) establishing a novel connection between bilevel optimization and stochastic optimization under distributional drift. Our experiments on various tasks show that our algorithm significantly outperforms strong baselines in bilevel optimization.