A Self-Constructing Multi-Expert Fuzzy System for High-dimensional Data Classification
This work addresses classification problems for high-dimensional and noisy data in machine learning, representing an incremental improvement with a novel hybrid method.
The paper tackles challenges in Fuzzy Neural Networks for high-dimensional data classification, such as vanishing gradients and excessive rules, by proposing a Self-Constructing Multi-Expert Fuzzy System that combines mixed structure learning and multi-expert advanced learning, resulting in enhanced robustness and stability as demonstrated in experiments on high-dimensional tabular data.
Fuzzy Neural Networks (FNNs) are effective machine learning models for classification tasks, commonly based on the Takagi-Sugeno-Kang (TSK) fuzzy system. However, when faced with high-dimensional data, especially with noise, FNNs encounter challenges such as vanishing gradients, excessive fuzzy rules, and limited access to prior knowledge. To address these challenges, we propose a novel fuzzy system, the Self-Constructing Multi-Expert Fuzzy System (SOME-FS). It combines two learning strategies: mixed structure learning and multi-expert advanced learning. The former enables each base classifier to effectively determine its structure without requiring prior knowledge, while the latter tackles the issue of vanishing gradients by enabling each rule to focus on its local region, thereby enhancing the robustness of the fuzzy classifiers. The overall ensemble architecture enhances the stability and prediction performance of the fuzzy system. Our experimental results demonstrate that the proposed SOME-FS is effective in high-dimensional tabular data, especially in dealing with uncertainty. Moreover, our stable rule mining process can identify concise and core rules learned by the SOME-FS.