Analysis of Regularized Learning in Banach Spaces for Linear-functional Data
This work provides a theoretical foundation for regularized learning in abstract spaces, which is incremental for researchers in mathematical machine learning.
The paper tackles the theoretical analysis of regularized learning in Banach spaces for linear-functional data, establishing convergence theorems to approximate solutions of uncertain problems, with applications to classical machine learning methods like support vector machines and neural networks.
This article delves into the study of the theory of regularized learning in Banach spaces for linear-functional data. It encompasses discussions on representer theorems, pseudo-approximation theorems, and convergence theorems. Regularized learning is designed to minimize regularized empirical risks over a Banach space. The empirical risks are calculated by utilizing training data and multi-loss functions. The input training data are composed of linear functionals in a predual space of the Banach space to capture discrete local information from multimodal data and multiscale models. Through the regularized learning, approximations of the exact solution to an unidentified or uncertain original problem are globally achieved. In the convergence theorems, the convergence of the approximate solutions to the exact solution is established through the utilization of the weak* topology of the Banach space. The theorems of regularized learning are utilized in the interpretation of classical machine learning, such as support vector machines and artificial neural networks.