Validating Emergency Department Admission Predictions Based on Local Data Through MIMIC-IV
This provides a validation approach for healthcare models using public benchmarks, but it is incremental as it applies existing methods to new data without methodological innovation.
This study validated emergency department admission prediction models developed on a small Greek hospital dataset by testing them on the larger MIMIC-IV dataset, finding that Random Forest achieved near-perfect performance with an AUC-ROC of 0.9999, sensitivity of 0.9997, and specificity of 0.9999.
The effective management of Emergency Department (ED) overcrowding is essential for improving patient outcomes and optimizing healthcare resource allocation. This study validates hospital admission prediction models initially developed using a small local dataset from a Greek hospital by leveraging the comprehensive MIMIC-IV dataset. After preprocessing the MIMIC-IV data, five algorithms were evaluated: Linear Discriminant Analysis (LDA), K-Nearest Neighbors (KNN), Random Forest (RF), Recursive Partitioning and Regression Trees (RPART), and Support Vector Machines (SVM Radial). Among these, RF demonstrated superior performance, achieving an Area Under the Receiver Operating Characteristic Curve (AUC-ROC) of 0.9999, sensitivity of 0.9997, and specificity of 0.9999 when applied to the MIMIC-IV data. These findings highlight the robustness of RF in handling complex datasets for admission prediction, establish MIMIC-IV as a valuable benchmark for validating models based on smaller local datasets, and provide actionable insights for improving ED management strategies.