Provable convergence guarantees for black-box variational inference
This provides rigorous convergence guarantees for widely used variational inference methods, addressing a theoretical gap in machine learning.
The paper tackled the lack of convergence guarantees for black-box variational inference by proving that gradient estimators for dense Gaussian families satisfy a quadratic noise bound, enabling novel convergence proofs for stochastic gradient descent methods.
Black-box variational inference is widely used in situations where there is no proof that its stochastic optimization succeeds. We suggest this is due to a theoretical gap in existing stochastic optimization proofs: namely the challenge of gradient estimators with unusual noise bounds, and a composite non-smooth objective. For dense Gaussian variational families, we observe that existing gradient estimators based on reparameterization satisfy a quadratic noise bound and give novel convergence guarantees for proximal and projected stochastic gradient descent using this bound. This provides rigorous guarantees that methods similar to those used in practice converge on realistic inference problems.