CVLGOct 17, 2022

Learning Diversified Feature Representations for Facial Expression Recognition in the Wild

arXiv:2210.09381v24 citationsh-index: 41
Originality Incremental advance
AI Analysis

This work addresses the challenge of extracting discriminative features from occluded images in real-world scenarios for facial expression recognition, representing an incremental improvement over existing methods.

The paper tackled the problem of improving facial expression recognition in the wild by diversifying feature representations in deep neural networks, achieving state-of-the-art accuracies of 89.99% on RAF-DB and 89.34% on FER+, and a competitive 60.02% on AffectNet.

Diversity of the features extracted by deep neural networks is important for enhancing the model generalization ability and accordingly its performance in different learning tasks. Facial expression recognition in the wild has attracted interest in recent years due to the challenges existing in this area for extracting discriminative and informative features from occluded images in real-world scenarios. In this paper, we propose a mechanism to diversify the features extracted by CNN layers of state-of-the-art facial expression recognition architectures for enhancing the model capacity in learning discriminative features. To evaluate the effectiveness of the proposed approach, we incorporate this mechanism in two state-of-the-art models to (i) diversify local/global features in an attention-based model and (ii) diversify features extracted by different learners in an ensemble-based model. Experimental results on three well-known facial expression recognition in-the-wild datasets, AffectNet, FER+, and RAF-DB, show the effectiveness of our method, achieving the state-of-the-art performance of 89.99% on RAF-DB, 89.34% on FER+ and the competitive accuracy of 60.02% on AffectNet dataset.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes