Video Person Re-Identification using Learned Clip Similarity Aggregation
This addresses the problem of identifying individuals across video sequences for surveillance or security applications, with incremental improvements over existing methods.
The paper tackles video-based person re-identification by using a learned clip similarity aggregation function to filter out uninformative clip pairs, achieving better or competitive performance on three public benchmarks.
We address the challenging task of video-based person re-identification. Recent works have shown that splitting the video sequences into clips and then aggregating clip based similarity is appropriate for the task. We show that using a learned clip similarity aggregation function allows filtering out hard clip pairs, e.g. where the person is not clearly visible, is in a challenging pose, or where the poses in the two clips are too different to be informative. This allows the method to focus on clip-pairs which are more informative for the task. We also introduce the use of 3D CNNs for video-based re-identification and show their effectiveness by performing equivalent to previous works, which use optical flow in addition to RGB, while using RGB inputs only. We give quantitative results on three challenging public benchmarks and show better or competitive performance. We also validate our method qualitatively.