Optimal Sampling Points in Reproducing Kernel Hilbert Spaces
This work addresses a fundamental challenge in signal processing and machine learning for applications like compressed sensing, though it appears incremental as it builds on existing frameworks.
The paper tackles the problem of optimally distributing a limited number of sampling points for efficient information extraction, such as in compressed sensing, by formulating it as a minimization problem under an optimal reconstruction framework and developing a computationally favorable algorithm based on Karhunen-Loeve transform, with numerical experiments demonstrating its performance.
The recent developments of basis pursuit and compressed sensing seek to extract information from as few samples as possible. In such applications, since the number of samples is restricted, one should deploy the sampling points wisely. We are motivated to study the optimal distribution of finite sampling points. Formulation under the framework of optimal reconstruction yields a minimization problem. In the discrete case, we estimate the distance between the optimal subspace resulting from a general Karhunen-Loeve transform and the kernel space to obtain another algorithm that is computationally favorable. Numerical experiments are then presented to illustrate the performance of the algorithms for the searching of optimal sampling points.