OLC-WA: Drift Aware Tuning-Free Online Classification with Weighted Average
This addresses the challenge of maintaining predictive accuracy in streaming data applications where distributions change over time, representing a strong incremental improvement in online learning methods.
The paper tackles the problem of concept drift in online classification by introducing OLC-WA, a hyperparameter-free model that uses weighted averaging and automatic optimization to adapt to evolving data distributions. Empirical results show it maintains accuracy within 1-3% of batch models in stationary environments and outperforms online baselines by 10-25% under drift.
Real-world data sets often exhibit temporal dynamics characterized by evolving data distributions. Disregarding this phenomenon, commonly referred to as concept drift, can significantly diminish a model's predictive accuracy. Furthermore, the presence of hyperparameters in online models exacerbates this issue. These parameters are typically fixed and cannot be dynamically adjusted by the user in response to the evolving data distribution. This paper introduces Online Classification with Weighted Average (OLC-WA), an adaptive, hyperparameter-free online classification model equipped with an automated optimization mechanism. OLC-WA operates by blending incoming data streams with an existing base model. This blending is facilitated by an exponentially weighted moving average. Furthermore, an integrated optimization mechanism dynamically detects concept drift, quantifies its magnitude, and adjusts the model based on the observed data stream characteristics. This approach empowers the model to effectively adapt to evolving data distributions within streaming environments. Rigorous empirical evaluation across diverse benchmark datasets shows that OLC-WA achieves performance comparable to batch models in stationary environments, maintaining accuracy within 1-3%, and surpasses leading online baselines by 10-25% under drift, demonstrating its effectiveness in adapting to dynamic data streams.