A Scalable and Efficient Iterative Method for Copying Machine Learning Classifiers
This incremental improvement addresses resource efficiency for companies using machine learning models in production.
The paper tackles the problem of efficiently replicating machine learning classifiers under external constraints by introducing a sequential copying method that reduces computational resources and maintenance costs, demonstrating significant reductions in time and resources while maintaining or improving accuracy in experiments.
Differential replication through copying refers to the process of replicating the decision behavior of a machine learning model using another model that possesses enhanced features and attributes. This process is relevant when external constraints limit the performance of an industrial predictive system. Under such circumstances, copying enables the retention of original prediction capabilities while adapting to new demands. Previous research has focused on the single-pass implementation for copying. This paper introduces a novel sequential approach that significantly reduces the amount of computational resources needed to train or maintain a copy, leading to reduced maintenance costs for companies using machine learning models in production. The effectiveness of the sequential approach is demonstrated through experiments with synthetic and real-world datasets, showing significant reductions in time and resources, while maintaining or improving accuracy.