Tommaso Vanzan

Kristin Kirchner, Fabio Nobile, Christoph Schwab et al.

We present a theoretical and numerical analysis of Monte Carlo methods for the estimation of statistical moments of random variables $X:Ω\rightarrow E$ taking values in a Banach space $E$. For practical computation, we consider finite-dimensional approximation subspaces ${(E_\ell)_{\ell\in\mathbb{N}}\subset E}$ of increasing dimension. We develop a refined error analysis that explicitly accounts for a dependence of the Rademacher type constants on the dimension of $E_\ell$, leading to novel complexity results for single- and multilevel Monte Carlo methods to estimate the mean and injective moments of arbitrary order, which are, in certain cases, sharper than those derived in [Kirchner, Schwab, J. Funct. Anal, 2024]. Moreover, we show that, in favorable cases, the resulting error-vs.-work bounds are independent of the Rademacher type of $E$. We then focus on $L^p(S)$-valued random variables for a $σ$-finite measure space satisfying certain approximation properties, and prove that for a random variable $X\in L^q(Ω;L^p(S))\cap L^p(S;L^q(Ω))$, with $q\in (1,\infty)$ and $p\in [1,\infty)$, the $L^q$-convergence rate of a Monte Carlo estimator is determined exclusively by the integrability parameter $\min\{q,2\}$, with no dependence on the Rademacher type $\min\{p,2\}$ of $L^p(S)$. We further investigate the impact of measuring the (multilevel) Monte Carlo error in the $L^q(Ω;L^p(S))$-norm while $X$ possesses additional regularity, $X\in L^{\tilde{q}}(Ω;L^p(S))\cap L^p(S;L^{\tilde{q}}(Ω))$ with $\tilde{q}\in [q,\infty)$. This analysis reveals an interplay between the sampling error and the strong approximation error, and leads to optimized error-vs.-work bounds for both single- and multilevel Monte Carlo methods. Numerical experiments confirm the sharpness of the analyses presented.

Eliott Van Dieren, Tommaso Vanzan, Fabio Nobile

We introduce LAGO, a LocAl-Global Optimization algorithm that combines gradient-enhanced Bayesian Optimization (BO) with gradient-based trust region local refinement through an adaptive competition mechanism. At each iteration, global and local optimization strategies independently propose candidate points, and the next evaluation is selected based on predicted improvement. LAGO separates global exploration from local refinement at the proposal level: the BO acquisition function is optimized outside the active trust region, while local function and gradient evaluations are incorporated into the global gradient-enhanced Gaussian process only when they satisfy a lengthscale-based minimum-distance criterion, reducing the risk of numerical instability during the local exploitation. This enables efficient local refinement when reaching promising regions, without sacrificing a global search of the design space. As a result, the method achieves an improved exploration of the full design space compared to standard non-linear local optimization algorithms for smooth functions, while maintaining fast local convergence in regions of interest.

Marco Sutti, Tommaso Vanzan

We propose a computational framework for computing low-rank approximations to the ensemble of solutions of a parametrized system of the form $A(ξ)x(ξ)+g(x(ξ))=b(ξ)$ for multiple parameter values. The central idea is to reinterpret the parametrized system as the first-order optimality condition of an optimization problem set over the space of real matrices, which is then minimized over the manifold of fixed-rank matrices. This formulation enables the use of Riemannian optimization techniques, including conjugate gradient and trust-region methods, and covers both linear and nonlinear instances under mild assumptions on the structure of the parametrized system. We further provide a theoretical analysis establishing conditions under which the solution matrix admits accurate low-rank approximations, extending existing results from linear to nonlinear problems. To enhance computational efficiency and robustness, we discuss tailored preconditioning strategies and a rank-compression mechanism to control the rank growth induced by nonlinearities. Numerical experiments demonstrate that the proposed approach achieves significant computational savings compared to solving each system independently, as well as highlight the potential of Riemannian optimization methods for low-rank approximations in large-scale parametrized nonlinear problems.