A random shuffle method to expand a narrow dataset and overcome the associated challenges in a clinical study: a heart failure cohort example
This method addresses the challenge of small sample sizes and missing data in clinical studies, particularly for heart failure research, by providing a statistically legitimate way to expand datasets.
This study developed a random shuffle method to expand the cardinality of narrow clinical datasets, specifically a heart failure cohort. The method successfully increased the dataset's cardinality approximately 10-fold, and up to 21-fold when combined with a random repeated-measures approach, without relying on specific hypotheses or regression models.
Heart failure (HF) affects at least 26 million people worldwide, so predicting adverse events in HF patients represents a major target of clinical data science. However, achieving large sample sizes sometimes represents a challenge due to difficulties in patient recruiting and long follow-up times, increasing the problem of missing data. To overcome the issue of a narrow dataset cardinality (in a clinical dataset, the cardinality is the number of patients in that dataset), population-enhancing algorithms are therefore crucial. The aim of this study was to design a random shuffle method to enhance the cardinality of an HF dataset while it is statistically legitimate, without the need of specific hypotheses and regression models. The cardinality enhancement was validated against an established random repeated-measures method with regard to the correctness in predicting clinical conditions and endpoints. In particular, machine learning and regression models were employed to highlight the benefits of the enhanced datasets. The proposed random shuffle method was able to enhance the HF dataset cardinality (711 patients before dataset preprocessing) circa 10 times and circa 21 times when followed by a random repeated-measures approach. We believe that the random shuffle method could be used in the cardiovascular field and in other data science problems when missing data and the narrow dataset cardinality represent an issue.