STDSLGFAPRJul 24, 2025

Zeroth-order log-concave sampling

arXiv:2507.18021v13 citationsh-index: 9
Originality Incremental advance
AI Analysis

This work addresses efficient sampling for high-dimensional convex optimization and machine learning, offering incremental improvements in query complexity for log-concave distributions.

The paper tackles the problem of sampling from log-concave distributions using zeroth-order queries, achieving a query complexity of \(\widetilde{O}(qM_{q}^{q/(q-1)}d^{2}\lVert\operatorname{cov}\pi\rVert\log\frac{1}{\varepsilon})\) for uniform sampling from convex bodies with membership oracles, and introduces an annealing scheme to produce warm starts with \(M_{q}=O(1)\) using \(\widetilde{O}(qd^{2}R^{3/2}\lVert\operatorname{cov}\pi\rVert^{1/4})\) queries.

We study the zeroth-order query complexity of log-concave sampling, specifically uniform sampling from convex bodies using membership oracles. We propose a simple variant of the proximal sampler that achieves the query complexity with matched Rényi orders between the initial warmness and output guarantee. Specifically, for any $\varepsilon>0$ and $q\geq2$, the sampler, initialized at $π_{0}$, outputs a sample whose law is $\varepsilon$-close in $q$-Rényi divergence to $π$, the uniform distribution over a convex body in $\mathbb{R}^{d}$, using $\widetilde{O}(qM_{q}^{q/(q-1)}d^{2}\,\lVert\operatorname{cov}π\rVert\log\frac{1}{\varepsilon})$ membership queries, where $M_{q}=\lVert\text{d}π_{0}/\text{d}π\rVert_{L^{q}(π)}$. We further introduce a simple annealing scheme that produces a warm start in $q$-Rényi divergence (i.e., $M_{q}=O(1)$) using $\widetilde{O}(qd^{2}R^{3/2}\,\lVert\operatorname{cov}π\rVert^{1/4})$ queries, where $R^{2}=\mathbb{E}_π[|\cdot|^{2}]$. This interpolates between known complexities for warm-start generation in total variation and Rényi-infinity divergence. To relay a Rényi warmness across the annealing scheme, we establish hypercontractivity under simultaneous heat flow and translate it into an improved mixing guarantee for the proximal sampler under a logarithmic Sobolev inequality. These results extend naturally to general log-concave distributions accessible via evaluation oracles, incurring additional quadratic queries.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes