1.2NAOct 27, 2010
Multigrid methods for Toeplitz linear systems with different size reductionMarco Donatelli, Stefano Serra-Capizzano, Debora Sesana
Starting from the spectral analysis of g-circulant matrices, we consider a new multigrid method for circulant and Toeplitz matrices with given generating function. We assume that the size n of the coefficient matrix is divisible by g \geq 2 such that at the lower level the system is reduced to one of size n/g by employing g-circulant based projectors. We perform a rigorous two-grid convergence analysis in the circulant case and we extend experimentally the results to the Toeplitz setting, by employing structure preserving projectors. The optimality of the proposed two-grid method and of the multigrid method is proved, when the number theta \in N of recursive calls is such that 1 < theta < g. The previous analysis is used also to overcome some pathological cases, in which the generating function has zeros located at "mirror points" and the standard two-grid method with g = 2 is not optimal. The numerical experiments show the correctness and applicability of the proposed ideas both for circulant and Toeplitz matrices.
2.3NANov 27, 2010
Fast Preconditioners for Total Variation Deblurring with Anti-Reflective Boundary ConditionsZheng-Jian Bai, Marco Donatelli, Stefano Serra-Capizzano
In recent works several authors have proposed the use of precise boundary conditions (BCs) for blurring models and they proved that the resulting choice (Neumann or reflective, anti-reflective) leads to fast algorithms both for deblurring and for detecting the regularization parameters in presence of noise. When considering a symmetric point spread function, the crucial fact is that such BCs are related to fast trigonometric transforms. In this paper we combine the use of precise BCs with the Total Variation (TV) approach in order to preserve the jumps of the given signal (edges of the given image) as much as possible. We consider a classic fixed point method with a preconditioned Krylov method (usually the conjugate gradient method) for the inner iteration. Based on fast trigonometric transforms, we propose some preconditioning strategies which are suitable for reflective and anti-reflective BCs. A theoretical analysis motivates the choice of our preconditioners and an extensive numerical experimentation is reported and critically discussed. The latter shows that the TV regularization with anti-reflective BCs implies not only a reduced analytical error, but also a lower computational cost of the whole restoration procedure over the other BCs.
1.2NAJul 16, 2008
A note on grid transfer operators for multigrid methodsMarco Donatelli
The Local Fourier analysis (LFA) is a classic tool to prove convergence theorems for multigrid methods (MGMs). In particular, we are interested in optimality that is a convergence speed independent of the size of the involved matrices. For elliptic partial differential equations (PDEs), a well known optimality result requires that the sum of the orders of the grid transfer operators is not lower than the order of the PDE to solve. Analogously, when dealing with MGMs for Toeplitz matrices in the literature an optimality condition on the position and on the order of the zeros of the symbols of the grid transfer operators has been found. In this work we show that in the case of elliptic PDEs with constant coefficients, the two different approaches lead to an equivalent condition. We argue that the analysis for Toeplitz matrices is an algebraic generalization of the LFA, which allows to deal not only with differential problems but also for instance with integral problems. The equivalence of the two approaches gives the possibility of using grid transfer operators with different orders also for MGMs for Toeplitz matrices. We give also a class of grid transfer operators related to the B-spline's refinement equation and we study their geometric properties. This analysis suggests further links between wavelets and multigrid methods. A numerical experimentation confirms the correctness of the proposed analysis.
Graph Iterative Filtering methods for the analysis of nonstationary signals on graphsGiuseppe Scarlato, Antonio Cicone, Marco Donatelli
In the analysis of real-world data, extracting meaningful features from signals is a crucial task. This is particularly challenging when signals contain non-stationary frequency components. The Iterative Filtering (IF) method has proven to be an effective tool for decomposing such signals. However, such a technique cannot handle directly data that have been sampled non-uniformly. On the other hand, graph signal processing has gained increasing attention due to its versatility and wide range of applications, and it can handle data sampled both uniformly and non-uniformly. In this work, we propose two algorithms that extend the IF method to signals defined on graphs. In addition, we provide a unified convergence analysis for the different IF variants. Finally, numerical experiments on a variety of graphs, including real-world data, confirm the effectiveness of the proposed methods. In particular, we test our algorithms on seismic data and the total electron content of the ionosphere. Those data are by their nature non-uniformly sampled, and, therefore, they cannot be directly analyzed by the standard IF method.
1.2NANov 1, 2025
Trust-Region Methods with Low-Fidelity Objective ModelsAndrea Angino, Matteo Aurina, Alena Kopaničáková et al.
We introduce two multifidelity trust-region methods based on the Magical Trust Region (MTR) framework. MTR augments the classical trust-region step with a secondary, informative direction. In our approaches, the secondary ``magical'' directions are determined by solving coarse trust-region subproblems based on low-fidelity objective models. The first proposed method, Sketched Trust-Region (STR), constructs this secondary direction using a sketched matrix to reduce the dimensionality of the trust-region subproblem. The second method, SVD Trust-Region (SVDTR), defines the magical direction via a truncated singular value decomposition of the dataset, capturing the leading directions of variability. Several numerical examples illustrate the potential gain in efficiency.
9.4OCMar 10, 2024
Whiteness-based bilevel learning of regularization parameters in imagingCarlo Santambrogio, Monica Pragliola, Alessandro Lanza et al.
We consider an unsupervised bilevel optimization strategy for learning regularization parameters in the context of imaging inverse problems in the presence of additive white Gaussian noise. Compared to supervised and semi-supervised metrics relying either on the prior knowledge of reference data and/or on some (partial) knowledge on the noise statistics, the proposed approach optimizes the whiteness of the residual between the observed data and the observation model with no need of ground-truth data.We validate the approach on standard Total Variation-regularized image deconvolution problems which show that the proposed quality metric provides estimates close to the mean-square error oracle and to discrepancy-based principles.
1.2NAJun 3, 2019
Convergence and normal continuity analysis of non-stationary subdivision schemes near extraordinary vertices and facesCostanza Conti, Marco Donatelli, Lucia Romani et al.
Convergence and normal continuity analysis of a bivariate non-stationary (level-dependent) subdivision scheme for 2-manifold meshes with arbitrary topology is still an open issue. Exploiting ideas from the theory of asymptotically equivalent subdivision schemes, in this paper we derive new sufficient conditions for establishing convergence and normal continuity of any rotationally symmetric, non-stationary, subdivision scheme near an extraordinary vertex/face.
1.2NAAug 11, 2017
Anisotropic, interpolatory subdivision and multigridMaria Charina, Marco Donatelli, Lucia Romani et al.
In this paper, we present a family of multivariate grid transfer operators appropriate for anisotropic multigrid methods. Our grid transfer operators are derived from a new family of anisotropic interpolatory subdivision schemes. We study the minimality, polynomial reproduction and convergence properties of these interpolatory schemes and link their properties to the convergence and optimality of the corresponding multigrid methods. We compare the performance of our interpolarory grid transfer operators with the ones derived from a family of corresponding approximating subdivision schemes.
1.2NAAug 11, 2016
Multigrid methods: grid transfer operators and subdivision schemesMaria Charina, Marco Donatelli, Lucia Romani et al.
The convergence rate of a multigrid method depends on the properties of the smoother and the so-called grid transfer operator. In this paper we define and analyze new grid transfer operators with a generic cutting size which are applicable for high order problems. We enlarge the class of available geometric grid transfer operators by relating the symbol analysis of the coarse grid correction with the approximation properties of univariate subdivision schemes. We show that the polynomial generation property and stability of a subdivision scheme are crucial for convergence and optimality of the corresponding multigrid method. We construct a new class of grid transfer operators from primal binary and ternary pseudo-spline symbols. Our numerical results illustrate the behavior of the new grid transfer operators.
1.2NAJun 15, 2009
Fast transforms for high order boundary conditionsMarco Donatelli
We study strategies for increasing the precision in the blurring models by maintaining a complexity in the related numerical linear algebra procedures (matrix-vector product, linear system solution, computation of eigenvalues etc.) of the same order of the celebrated Fast Fourier Transform. The key idea is the choice of a suitable functional basis for representing signals and images. Starting from an analysis of the spectral decomposition of blurring matrices associated to the antireflective boundary conditions introduced in [S. Serra Capizzano, SIAM J. Sci. Comput. 25-3 pp. 1307--1325], we extend the model for preserving polynomials of higher degree and fast computations also in the nonsymmetric case. We apply the proposed model to Tikhonov regularization with smoothing norms and the generalized cross validation for choosing the regularization parameter. A selection of numerical experiments shows the effectiveness of the proposed techniques.