TimeMatch: Unsupervised Cross-Region Adaptation by Temporal Shift Estimation
This addresses the challenge of cross-region adaptation in agricultural remote sensing, enabling more accurate crop classification without labeled data in new areas, though it is incremental as it builds on existing domain adaptation techniques.
The paper tackled the problem of poor performance of deep learning models for crop classification from satellite image time series when applied to new regions without labels, due to temporal shifts in crop phenology, and proposed TimeMatch, which explicitly estimates and corrects for these shifts, resulting in an 11% average F1-score improvement over competing methods.
The recent developments of deep learning models that capture complex temporal patterns of crop phenology have greatly advanced crop classification from Satellite Image Time Series (SITS). However, when applied to target regions spatially different from the training region, these models perform poorly without any target labels due to the temporal shift of crop phenology between regions. Although various unsupervised domain adaptation techniques have been proposed in recent years, no method explicitly learns the temporal shift of SITS and thus provides only limited benefits for crop classification. To address this, we propose TimeMatch, which explicitly accounts for the temporal shift for improved SITS-based domain adaptation. In TimeMatch, we first estimate the temporal shift from the target to the source region using the predictions of a source-trained model. Then, we re-train the model for the target region by an iterative algorithm where the estimated shift is used to generate accurate target pseudo-labels. Additionally, we introduce an open-access dataset for cross-region adaptation from SITS in four different regions in Europe. On our dataset, we demonstrate that TimeMatch outperforms all competing methods by 11% in average F1-score across five different adaptation scenarios, setting a new state-of-the-art in cross-region adaptation.