1.2ITFeb 21, 2017
Phaseless Sampling and Reconstruction of Real-Valued Signals in Shift-Invariant SpacesCheng Cheng, Junzheng Jiang, Qiyu Sun
Sampling in shift-invariant spaces is a realistic model for signals with smooth spectrum. In this paper, we consider phaseless sampling and reconstruction of real-valued signals in a shift-invariant space from their magnitude measurements on the whole Euclidean space and from their phaseless samples taken on a discrete set with finite sampling density. We introduce an undirected graph to a signal and use connectivity of the graph to characterize whether the signal can be determined, up to a sign, from its magnitude measurements on the whole Euclidean space. Under the local complement property assumption on a shift-invariant space, we find a discrete set with finite sampling density such that signals in the shift-invariant space, that are determined from their magnitude measurements on the whole Euclidean space, can be reconstructed in a stable way from their phaseless samples taken on that discrete set. In this paper, we also propose a reconstruction algorithm which provides a suboptimal approximation to the original signal when its noisy phaseless samples are available only. Finally, numerical simulations are performed to demonstrate the robust reconstruction of box spline signals from their noisy phaseless samples.
4.3MLNov 6, 2023
Barron Space for Graph Convolution Neural NetworksSeok-Young Chung, Qiyu Sun
Graph convolutional neural network (GCNN) operates on graph domain and it has achieved a superior performance to accomplish a wide range of tasks. In this paper, we introduce a Barron space of functions on a compact domain of graph signals. We prove that the proposed Barron space is a reproducing kernel Banach space, it can be decomposed into the union of a family of reproducing kernel Hilbert spaces with neuron kernels, and it could be dense in the space of continuous functions on the domain. Approximation property is one of the main principles to design neural networks. In this paper, we show that outputs of GCNNs are contained in the Barron space and functions in the Barron space can be well approximated by outputs of some GCNNs in the integrated square and uniform measurements. We also estimate the Rademacher complexity of functions with bounded Barron norm and conclude that functions in the Barron space could be learnt from their random samples efficiently.
1.2ITJun 11, 2015
Nonlinear frames and sparse reconstructions in Banach spacesQiyu Sun, Wai-Shing Tang
In the first part of this paper, we consider nonlinear extension of frame theory by introducing bi-Lipschitz maps $F$ between Banach spaces. Our linear model of bi-Lipschitz maps is the analysis operator associated with Hilbert frames, $p$-frames, Banach frames, g-frames and fusion frames. In general Banach space setting, stable algorithm to reconstruct a signal $x$ from its noisy measurement $F(x)+ε$ may not exist. In this paper, we establish exponential convergence of two iterative reconstruction algorithms when $F$ is not too far from some bounded below linear operator with bounded pseudo-inverse, and when $F$ is a well-localized map between two Banach spaces with dense Hilbert subspaces. The crucial step to prove the later conclusion is a novel fixed point theorem for a well-localized map on a Banach space. In the second part of this paper, we consider stable reconstruction of sparse signals in a union ${\bf A}$ of closed linear subspaces of a Hilbert space ${\bf H}$ from their nonlinear measurements. We create an optimization framework called sparse approximation triple $({\bf A}, {\bf M}, {\bf H})$, and show that the minimizer $$x^*={\rm argmin}_{\hat x\in {\mathbf M}\ {\rm with} \ \|F(\hat x)-F(x^0)\|\le ε} \|\hat x\|_{\mathbf M}$$ provides a suboptimal approximation to the original sparse signal $x^0\in {\bf A}$ when the measurement map $F$ has the sparse Riesz property and almost linear property on ${\mathbf A}$. The above two new properties is also discussed in this paper when $F$ is not far away from a linear measurement operator $T$ having the restricted isometry property.
1.2ITOct 7, 2014
Sampling and Galerkin reconstruction in reproducing kernel spacesCheng Cheng, Yingchun Jiang, Qiyu Sun
In this paper, we consider sampling in a reproducing kernel subspace of $L^p$. We introduce a pre-reconstruction operator associated with a sampling scheme and propose a Galerkin reconstruction in general Banach space setting. We show that the proposed Galerkin method provides a quasi-optimal approximation, and the corresponding Galerkin equations could be solved by an iterative approximation-projection algorithm. We also present detailed analysis and numerical simulations of the Galerkin method for reconstructing signals with finite rate of innovation.