A parameter-free clustering algorithm for missing datasets
This addresses the challenge of clustering incomplete data for practitioners in fields like data science and machine learning, offering a more automated solution, though it is incremental as it builds on decision graph methods.
The paper tackles the problem of clustering datasets with missing values by proposing a parameter-free algorithm called SDC, which eliminates the need for imputation and input parameters, achieving improvements of at least 13.7% in NMI, 23.8% in ARI, and 8.1% in Purity over baselines.
Missing datasets, in which some objects have missing values in certain dimensions, are prevalent in the Real-world. Existing clustering algorithms for missing datasets first impute the missing values and then perform clustering. However, both the imputation and clustering processes require input parameters. Too many input parameters inevitably increase the difficulty of obtaining accurate clustering results. Although some studies have shown that decision graphs can replace the input parameters of clustering algorithms, current decision graphs require equivalent dimensions among objects and are therefore not suitable for missing datasets. To this end, we propose a Single-Dimensional Clustering algorithm, i.e., SDC. SDC, which removes the imputation process and adapts the decision graph to the missing datasets by splitting dimension and partition intersection fusion, can obtain valid clustering results on the missing datasets without input parameters. Experiments demonstrate that, across three evaluation metrics, SDC outperforms baseline algorithms by at least 13.7%(NMI), 23.8%(ARI), and 8.1%(Purity).