A Reliable Framework for Human-in-the-Loop Anomaly Detection in Time Series
This addresses the issue of biases and unreliability in anomaly detection for domain experts in fields like finance and healthcare, though it is incremental as it builds on existing explanation techniques.
The paper tackles the problem of unreliable anomaly detection in time series by introducing HILAD, a framework for human-in-the-loop collaboration, which in user studies improved model understanding and reliability.
Time series anomaly detection is a critical machine learning task for numerous applications, such as finance, healthcare, and industrial systems. However, even high-performing models may exhibit potential issues such as biases, leading to unreliable outcomes and misplaced confidence. While model explanation techniques, particularly visual explanations, offer valuable insights by elucidating model attributions of their decision, many limitations still exist -- They are primarily instance-based and not scalable across the dataset, and they provide one-directional information from the model to the human side, lacking a mechanism for users to address detected issues. To fulfill these gaps, we introduce HILAD, a novel framework designed to foster a dynamic and bidirectional collaboration between humans and AI for enhancing anomaly detection models in time series. Through our visual interface, HILAD empowers domain experts to detect, interpret, and correct unexpected model behaviors at scale. Our evaluation through user studies with two models and three time series datasets demonstrates the effectiveness of HILAD, which fosters a deeper model understanding, immediate corrective actions, and model reliability enhancement.