Prototype Learning for Micro-gesture Classification
This work addresses fine-grained gesture recognition for applications like human-computer interaction, but it is incremental as it builds on existing methods for a specific challenge.
The paper tackled micro-gesture classification by using cross-modal fusion and prototypical refinement modules to improve feature discriminability, achieving first place in a challenge with a 6.13% increase in Top-1 accuracy over the previous leader.
In this paper, we briefly introduce the solution developed by our team, HFUT-VUT, for the track of Micro-gesture Classification in the MiGA challenge at IJCAI 2024. The task of micro-gesture classification task involves recognizing the category of a given video clip, which focuses on more fine-grained and subtle body movements compared to typical action recognition tasks. Given the inherent complexity of micro-gesture recognition, which includes large intra-class variability and minimal inter-class differences, we utilize two innovative modules, i.e., the cross-modal fusion module and prototypical refinement module, to improve the discriminative ability of MG features, thereby improving the classification accuracy. Our solution achieved significant success, ranking 1st in the track of Micro-gesture Classification. We surpassed the performance of last year's leading team by a substantial margin, improving Top-1 accuracy by 6.13%.