NAMar 1, 2016
Manifold-valued subdivision schemes based on geodesic inductive averagingNira Dyn, Nir Sharon
Subdivision schemes have become an important tool for approximation of manifold-valued functions. In this paper, we describe a construction of manifold-valued subdivision schemes for geodesically complete manifolds. Our construction is based upon the adaptation of linear subdivision schemes using the notion of repeated binary averaging, where as a repeated binary average we propose to use the geodesic inductive mean. We derive conditions on the adapted schemes which guarantee convergence from any initial manifold-valued sequence. The definition and analysis of convergence are intrinsic to the manifold. The adaptation technique and the convergence analysis are demonstrated by several important examples.
NADec 22, 2018
Evaluating Non-Analytic Functions of MatricesNir Sharon, Yoel Shkolnisky
The paper revisits the classical problem of evaluating $f(A)$ for a real function $f$ and a matrix $A$ with real spectrum. The evaluation is based on expanding $f$ in Chebyshev polynomials, and the focus of the paper is to study the convergence rates of these expansions. In particular, we derive bounds on the convergence rates which reveal the relation between the smoothness of $f$ and the diagonalizability of the matrix A. We present several numerical examples to illustrate our analysis.
NANov 3, 2016
Approximation operators for matrix-valued functions based on matrix decompositionsNira Dyn, Uri Itai, Nir Sharon
Given a set of matrices, modeled as samples of a matrix-valued function, we suggest a method to approximate the underline function using a product approximation operator. This operator extends known approximation methods by exploiting the structure of the matrices in the samples set, and based on decomposition theorems. We introduce our approach in detail and discuss its advantages using a few examples. In addition, we provide basic tools for analyzing properties of the matrix functions generated by our approximation operators.
MEApr 28, 2023
Deep Neural-network Prior for Orbit Recovery from Method of MomentsYuehaw Khoo, Sounak Paul, Nir Sharon
Orbit recovery problems are a class of problems that often arise in practice and various forms. In these problems, we aim to estimate an unknown function after being distorted by a group action and observed via a known operator. Typically, the observations are contaminated with a non-trivial level of noise. Two particular orbit recovery problems of interest in this paper are multireference alignment and single-particle cryo-EM modelling. In order to suppress the noise, we suggest using the method of moments approach for both problems while introducing deep neural network priors. In particular, our neural networks should output the signals and the distribution of group elements, with moments being the input. In the multireference alignment case, we demonstrate the advantage of using the NN to accelerate the convergence for the reconstruction of signals from the moments. Finally, we use our method to reconstruct simulated and biological volumes in the cryo-EM setting.
NAApr 10
Multiscaling in Wasserstein SpacesWael Mattar, Nir Sharon
We present a novel multiscale framework for analyzing sequences of probability measures in Wasserstein spaces over Euclidean domains. Exploiting the intrinsic geometry of optimal transport, we construct a multiscale transform applicable to both absolutely continuous and discrete measures. Central to our approach is a refinement operator based on McCann's interpolants, which preserves the geodesic structure of measure flows and serves as an upsampling mechanism. Building on this, we introduce the optimality number, a scalar that quantifies deviations of a sequence from Wasserstein geodesicity across scales, enabling the detection of irregular dynamics and anomalies. We establish key theoretical guarantees, including stability of the transform and geometric decay of coefficients, ensuring robustness and interpretability of the multiscale representation. Finally, we demonstrate the versatility of our methodology through numerical experiments: denoising and anomaly detection in Gaussian flows, analysis of point cloud dynamics under vector fields, and the multiscale characterization of neural network learning trajectories.
LGMay 17, 2024
Function Extrapolation with Neural Networks and Its Application for ManifoldsGuy Hay, Nir Sharon
This paper addresses the problem of accurately estimating a function on one domain when only its discrete samples are available on another domain. To answer this challenge, we utilize a neural network, which we train to incorporate prior knowledge of the function. In addition, by carefully analyzing the problem, we obtain a bound on the error over the extrapolation domain and define a condition number for this problem that quantifies the level of difficulty of the setup. Compared to other machine learning methods that provide time series prediction, such as transformers, our approach is suitable for setups where the interpolation and extrapolation regions are general subdomains and, in particular, manifolds. In addition, our construction leads to an improved loss function that helps us boost the accuracy and robustness of our neural network. We conduct comprehensive numerical tests and comparisons of our extrapolation versus standard methods. The results illustrate the effectiveness of our approach in various scenarios.
SPOct 21, 2025
SO(3)-invariant PCA with application to molecular dataMichael Fraiman, Paulina Hoyos, Tamir Bendory et al.
Principal component analysis (PCA) is a fundamental technique for dimensionality reduction and denoising; however, its application to three-dimensional data with arbitrary orientations -- common in structural biology -- presents significant challenges. A naive approach requires augmenting the dataset with many rotated copies of each sample, incurring prohibitive computational costs. In this paper, we extend PCA to 3D volumetric datasets with unknown orientations by developing an efficient and principled framework for SO(3)-invariant PCA that implicitly accounts for all rotations without explicit data augmentation. By exploiting underlying algebraic structure, we demonstrate that the computation involves only the square root of the total number of covariance entries, resulting in a substantial reduction in complexity. We validate the method on real-world molecular datasets, demonstrating its effectiveness and opening up new possibilities for large-scale, high-dimensional reconstruction problems.
LGJun 28, 2024
Wavelets Are All You Need for Autoregressive Image GenerationWael Mattar, Idan Levy, Nir Sharon et al.
In this paper, we take a new approach to autoregressive image generation that is based on two main ingredients. The first is wavelet image coding, which allows to tokenize the visual details of an image from coarse to fine details by ordering the information starting with the most significant bits of the most significant wavelet coefficients. The second is a variant of a language transformer whose architecture is re-designed and optimized for token sequences in this 'wavelet language'. The transformer learns the significant statistical correlations within a token sequence, which are the manifestations of well-known correlations between the wavelet subbands at various resolutions. We show experimental results with conditioning on the generation process.
CVNov 20, 2014
An algorithm for improving Non-Local Means operators via low-rank approximationVictor May, Yosi Keller, Nir Sharon et al.
We present a method for improving a Non Local Means operator by computing its low-rank approximation. The low-rank operator is constructed by applying a filter to the spectrum of the original Non Local Means operator. This results in an operator which is less sensitive to noise while preserving important properties of the original operator. The method is efficiently implemented based on Chebyshev polynomials and is demonstrated on the application of natural images denoising. For this application, we provide a comprehensive comparison of our method with leading denoising methods.