4.3NAMay 29, 2013
Eventual linear convergence of the Douglas Rachford iteration for basis pursuitLaurent Demanet, Xiangxiong Zhang
We provide a simple analysis of the Douglas-Rachford splitting algorithm in the context of $\ell^1$ minimization with linear constraints, and quantify the asymptotic linear convergence rate in terms of principal angles between relevant vector spaces. In the compressed sensing setting, we show how to bound this rate in terms of the restricted isometry constant. More general iterative schemes obtained by $\ell^2$-regularization and over-relaxation including the dual split Bregman method are also treated, which answers the question how to choose the relaxation and soft-thresholding parameters to accelerate the asymptotic convergence rate. We make no attempt at characterizing the transient regime preceding the onset of linear convergence.
1.2NAFeb 22, 2018
Asymptotic-preserving and positivity-preserving implicit-explicit schemes for the stiff BGK equationJingwei Hu, Ruiwen Shu, Xiangxiong Zhang
We develop a family of second-order implicit-explicit (IMEX) schemes for the stiff BGK kinetic equation. The method is asymptotic-preserving (can capture the Euler limit without numerically resolving the small Knudsen number) as well as positivity-preserving --- a feature that is not possessed by any of the existing second or high order IMEX schemes. The method is based on the usual IMEX Runge-Kutta framework plus a key correction step utilizing the special structure of the BGK operator. Formal analysis is presented to demonstrate the property of the method and is supported by various numerical results. Moreover, we show that the method satisfies an entropy-decay property when coupled with suitable spatial discretizations. Additionally, we discuss the generalization of the method to some hyperbolic relaxation system and provide a strategy to extend the method to third order.
7.4OCApr 8
Asymptotic Linear Convergence of ADMM for Isotropic TV Norm Compressed SensingEmmanuel Gil Torres, Matt Jacobs, Xiangxiong Zhang
We prove an explicit local linear rate for ADMM solving the isotropic Total Variation (TV) norm compressed sensing problem in multiple dimensions, by analyzing the auxiliary variable in the equivalent Douglas-Rachford splitting on a dual problem. Numerical verification on large 3D problems and real MRI data will be shown. Though the proven rate is not sharp, it is close to the observed ones in numerical tests. The proven rate is not sharp, but it provides an explicit upper bound that appears close to the observed convergence rate in numerical experiments, although we do not claim this behavior holds in general.
2.3NASep 8, 2023
Riemannian Langevin Monte Carlo schemes for sampling PSD matrices with fixed rankTianmin Yu, Shixin Zheng, Jianfeng Lu et al.
This paper introduces two explicit schemes to sample matrices from Gibbs distributions on $\mathcal S^{n,p}_+$, the manifold of real positive semi-definite (PSD) matrices of size $n\times n$ and rank $p$. Given an energy function $\mathcal E:\mathcal S^{n,p}_+\to \mathbb{R}$ and certain Riemannian metrics $g$ on $\mathcal S^{n,p}_+$, these schemes rely on an Euler-Maruyama discretization of the Riemannian Langevin equation (RLE) with Brownian motion on the manifold. We present numerical schemes for RLE under two fundamental metrics on $\mathcal S^{n,p}_+$: (a) the metric obtained from the embedding of $\mathcal S^{n,p}_+ \subset \mathbb{R}^{n\times n} $; and (b) the Bures-Wasserstein metric corresponding to quotient geometry. We also provide examples of energy functions with explicit Gibbs distributions that allow numerical validation of these schemes.
6.2NAMar 13
Computing the Gross-Pitaevskii Ground State via Wasserstein Gradient Flow in Diffeomorphism SpaceXiangxiong Zhang, Haomin Zhou
We compute the ground state $u$ of the Gross--Pitaevskii equation (GPE) via Wasserstein gradient descent in diffeomorphism space. We represent the density $Ï=u^2$ as the push-forward of a fixed reference measure through a parameterized transport map $T_θ$, realized by a boundary-preserving Neural ODE. The Wasserstein gradient flow on probability densities then lifts to natural gradient descent in the finite-dimensional parameter space, with metric tensor given by the pullback of the Wasserstein metric. The method is entirely mesh-free and preserves the unit-mass constraint without normalization. We present numerical experiments in dimensions $d=1,2,3$ and demonstrate that the parameterized Wasserstein gradient flow (PWGF) output can be used to initialize the $H^1$ Sobolev gradient flow, reducing the initial energy gap by a factor of $7$ in 2D and $4.5$ in 3D compared to trivial initial conditions.
1.2NAMay 15, 2019
On the monotonicity and discrete maximum principle of the finite difference implementation of $C^0$-$Q^2$ finite element methodHao Li, Xiangxiong Zhang
We show that the fourth order accurate finite difference implementation of continuous finite element method with tensor product of quadratic polynomial basis is monotone thus satisfies the discrete maximum principle for solving a scalar variable coefficient equation $-\nabla\cdot(a\nabla u)+cu=f$ under a suitable mesh constraint.