Integrated Object Detection and Tracking with Tracklet-Conditioned Detection
This addresses the issue of jittered and unstable object trajectories in video understanding, with incremental improvements over existing integrated methods.
The paper tackles the problem of improving synergy between object detection and tracking in video by conditioning detection on prior tracklets, resulting in smoother trajectories and state-of-the-art performance in detection and tracking accuracy.
Accurate detection and tracking of objects is vital for effective video understanding. In previous work, the two tasks have been combined in a way that tracking is based heavily on detection, but the detection benefits marginally from the tracking. To increase synergy, we propose to more tightly integrate the tasks by conditioning the object detection in the current frame on tracklets computed in prior frames. With this approach, the object detection results not only have high detection responses, but also improved coherence with the existing tracklets. This greater coherence leads to estimated object trajectories that are smoother and more stable than the jittered paths obtained without tracklet-conditioned detection. Over extensive experiments, this approach is shown to achieve state-of-the-art performance in terms of both detection and tracking accuracy, as well as noticeable improvements in tracking stability.