Jointly Attentive Spatial-Temporal Pooling Networks for Video-based Person Re-Identification
This improves person re-identification for applications in visual surveillance and human-computer interaction, representing an incremental advance over existing methods.
The paper tackles video-based person re-identification by proposing a joint Spatial and Temporal Attention Pooling Network (ASTPN) that selects informative regions and frames, achieving state-of-the-art results on datasets like iLIDS-VID, PRID-2011, and MARS.
Person Re-Identification (person re-id) is a crucial task as its applications in visual surveillance and human-computer interaction. In this work, we present a novel joint Spatial and Temporal Attention Pooling Network (ASTPN) for video-based person re-identification, which enables the feature extractor to be aware of the current input video sequences, in a way that interdependency from the matching items can directly influence the computation of each other's representation. Specifically, the spatial pooling layer is able to select regions from each frame, while the attention temporal pooling performed can select informative frames over the sequence, both pooling guided by the information from distance matching. Experiments are conduced on the iLIDS-VID, PRID-2011 and MARS datasets and the results demonstrate that this approach outperforms existing state-of-art methods. We also analyze how the joint pooling in both dimensions can boost the person re-id performance more effectively than using either of them separately.