Imbalanced Deep Learning by Minority Class Incremental Rectification
This addresses the problem of class imbalance in deep learning for applications like person attribute recognition, though it appears incremental as it builds on existing methods for imbalanced data.
The paper tackles the challenge of learning from significantly imbalanced training data in deep learning by proposing a batch-wise incremental minority class rectification model with a Class Rectification Loss function, achieving performance advantages over state-of-the-art models on imbalanced person attribute benchmarks.
Model learning from class imbalanced training data is a long-standing and significant challenge for machine learning. In particular, existing deep learning methods consider mostly either class balanced data or moderately imbalanced data in model training, and ignore the challenge of learning from significantly imbalanced training data. To address this problem, we formulate a class imbalanced deep learning model based on batch-wise incremental minority (sparsely sampled) class rectification by hard sample mining in majority (frequently sampled) classes during model training. This model is designed to minimise the dominant effect of majority classes by discovering sparsely sampled boundaries of minority classes in an iterative batch-wise learning process. To that end, we introduce a Class Rectification Loss (CRL) function that can be deployed readily in deep network architectures. Extensive experimental evaluations are conducted on three imbalanced person attribute benchmark datasets (CelebA, X-Domain, DeepFashion) and one balanced object category benchmark dataset (CIFAR-100). These experimental results demonstrate the performance advantages and model scalability of the proposed batch-wise incremental minority class rectification model over the existing state-of-the-art models for addressing the problem of imbalanced data learning.