Should we Reload Time Series Classification Performance Evaluation ? (a position paper)
This is an incremental position paper addressing methodological issues for researchers in time series classification.
The paper critiques current performance evaluation protocols in Time Series Classification (TSC) literature, aiming to stimulate discussion and reflection on how methods are compared using the UCR benchmark datasets.
Since the introduction and the public availability of the \textsc{ucr} time series benchmark data sets, numerous Time Series Classification (TSC) methods has been designed, evaluated and compared to each others. We suggest a critical view of TSC performance evaluation protocols put in place in recent TSC literature. The main goal of this `position' paper is to stimulate discussion and reflexion about performance evaluation in TSC literature.