Optimizing Basis Function Selection in Constructive Wavelet Neural Networks and Its Applications
This work addresses computational bottlenecks in wavelet neural networks for applications like signal processing and time-series analysis, offering a novel method that enhances efficiency and broad applicability.
The study tackled the problem of constructing accurate wavelet bases and high computational costs in wavelet neural networks by introducing a constructive framework that selects initial bases based on frequency analysis and prioritizes high-energy bases, resulting in significantly improved computational efficiency as demonstrated through various examples.
Wavelet neural network (WNN), which learns an unknown nonlinear mapping from the data, has been widely used in signal processing, and time-series analysis. However, challenges in constructing accurate wavelet bases and high computational costs limit their application. This study introduces a constructive WNN that selects initial bases and trains functions by introducing new bases for predefined accuracy while reducing computational costs. For the first time, we analyze the frequency of unknown nonlinear functions and select appropriate initial wavelets based on their primary frequency components by estimating the energy of the spatial frequency component. This leads to a novel constructive framework consisting of a frequency estimator and a wavelet-basis increase mechanism to prioritize high-energy bases, significantly improving computational efficiency. The theoretical foundation defines the necessary time-frequency range for high-dimensional wavelets at a given accuracy. The framework's versatility is demonstrated through four examples: estimating unknown static mappings from offline data, combining two offline datasets, identifying time-varying mappings from time-series data, and capturing nonlinear dependencies in real time-series data. These examples showcase the framework's broad applicability and practicality. All the code will be released at https://github.com/dshuangdd/CWNN.