LGCYAug 30, 2024

Common Steps in Machine Learning Might Hinder The Explainability Aims in Medicine

arXiv:2409.00155v1h-index: 2
Originality Synthesis-oriented
AI Analysis

This addresses the problem of balancing model performance with interpretability for medical practitioners, though it is incremental as it focuses on known issues in preprocessing.

The paper examines how standard data preprocessing steps in machine learning, while improving model accuracy, can undermine explainability in medical applications by blocking new findings, introducing unfairness, and making features clinically meaningless. It discusses these impacts and proposes solutions to maintain performance without sacrificing explainability.

Data pre-processing is a significant step in machine learning to improve the performance of the model and decreases the running time. This might include dealing with missing values, outliers detection and removing, data augmentation, dimensionality reduction, data normalization and handling the impact of confounding variables. Although it is found the steps improve the accuracy of the model, but they might hinder the explainability of the model if they are not carefully considered especially in medicine. They might block new findings when missing values and outliers removal are implemented inappropriately. In addition, they might make the model unfair against all the groups in the model when making the decision. Moreover, they turn the features into unitless and clinically meaningless and consequently not explainable. This paper discusses the common steps of the data preprocessing in machine learning and their impacts on the explainability and interpretability of the model. Finally, the paper discusses some possible solutions that improve the performance of the model while not decreasing its explainability.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes