Bi-Sparse Unsupervised Feature Selection
This work addresses the problem of unsupervised feature selection for researchers and practitioners dealing with high-dimensional unlabeled datasets, particularly in areas such as image processing, and presents an incremental improvement over existing PCA-based methods.
The authors tackled the problem of unsupervised feature selection in high-dimensional datasets and achieved improved performance with their bi-sparse method, BSUFS, which selects relevant features and filters out irrelevant noises. The method demonstrated its effectiveness through extensive numerical experiments on synthetic and real-world datasets.
To deal with high-dimensional unlabeled datasets in many areas, principal component analysis (PCA) has become a rising technique for unsupervised feature selection (UFS). However, most existing PCA-based methods only consider the structure of datasets by embedding a single sparse regularization or constraint on the transformation matrix. In this paper, we introduce a novel bi-sparse method called BSUFS to improve the performance of UFS. The core idea of BSUFS is to incorporate $\ell_{2,p}$-norm and $\ell_q$-norm into the classical PCA, which enables our method to select relevant features and filter out irrelevant noises, thereby obtaining discriminative features. Here, the parameters $p$ and $q$ are within the range of $[0, 1)$. Therefore, BSUFS not only constructs a unified framework for bi-sparse optimization, but also includes some existing works as special cases. To solve the resulting non-convex model, we propose an efficient proximal alternating minimization (PAM) algorithm using Stiefel manifold optimization and sparse optimization techniques. In addition, the computational complexity analysis is presented. Extensive numerical experiments on synthetic and real-world datasets demonstrate the effectiveness of our proposed BSUFS. The results reveal the advantages of bi-sparse optimization in feature selection and show its potential for other fields in image processing. Our code is available at https://github.com/xianchaoxiu/BSUFS.