Hierarchical Multiple Kernel K-Means Algorithm Based on Sparse Connectivity
This work addresses a specific bottleneck in hierarchical multiple kernel learning for clustering tasks, offering an incremental improvement over existing methods.
The paper tackled the problem of information interaction being ignored in hierarchical multiple kernel clustering by proposing a sparse connectivity-based algorithm (SCHMKKM) that controls connections between layers to improve discriminative information fusion, resulting in better performance than a fully connected baseline in cluster analysis on multiple datasets.
Multiple kernel learning (MKL) aims to find an optimal, consistent kernel function. In the hierarchical multiple kernel clustering (HMKC) algorithm, sample features are extracted layer by layer from a high-dimensional space to maximize the retention of effective information. However, information interaction between layers is often ignored. In this model, only corresponding nodes in adjacent layers exchange information; other nodes remain isolated, and if full connectivity is adopted, the diversity of the final consistency matrix is reduced. Therefore, this paper proposes a hierarchical multiple kernel K-Means (SCHMKKM) algorithm based on sparse connectivity, which controls the assignment matrix to achieve sparse connections through a sparsity rate, thereby locally fusing the features obtained by distilling information between layers. Finally, we conduct cluster analysis on multiple datasets and compare it with the fully connected hierarchical multiple kernel K-Means (FCHMKKM) algorithm in experiments. It is shown that more discriminative information fusion is beneficial for learning a better consistent partition matrix, and the fusion strategy based on sparse connection outperforms the full connection strategy.