Dual-level Adaptation for Multi-Object Tracking: Building Test-Time Calibration from Experience and Intuition
This addresses the problem of distribution shifts in MOT for computer vision applications, representing an incremental improvement by adapting existing test-time adaptation methods to better handle temporal consistency and identity association.
The paper tackles performance degradation in Multiple Object Tracking (MOT) due to distribution shifts between training and testing data by proposing a Test-time Calibration from Experience and Intuition (TCEI) framework, which achieves superior performance across multiple benchmark datasets and significantly enhances model adaptability.
Multiple Object Tracking (MOT) has long been a fundamental task in computer vision, with broad applications in various real-world scenarios. However, due to distribution shifts in appearance, motion pattern, and catagory between the training and testing data, model performance degrades considerably during online inference in MOT. Test-Time Adaptation (TTA) has emerged as a promising paradigm to alleviate such distribution shifts. However, existing TTA methods often fail to deliver satisfactory results in MOT, as they primarily focus solely on frame-level adaptation while neglecting temporal consistency and identity association across frames and videos. Inspired by human decision-making process, this paper propose a Test-time Calibration from Experience and Intuition (TCEI) framework. In this framework, the Intuitive system utilizes transient memory to recall recently observed objects for rapid predictions, while the Experiential system leverages the accumulated experience from prior test videos to reassess and calibrate these intuitive predictions. Furthermore, both confident and uncertain objects during online testing are exploited as historical priors and reflective cases, respectively, enabling the model to adapt to the testing environment and alleviate performance degradation. Extensive experiments demonstrate that the proposed TCEI framework consistently achieves superior performance across multiple benchmark datasets and significantly enhances the model's adaptability under distribution shifts. The code will be released at https://github.com/1941Zpf/TCEI.