LGCVNov 3, 2020

Self-semi-supervised Learning to Learn from NoisyLabeled Data

arXiv:2011.01429v11 citations
AI Analysis

This work addresses the costly issue of obtaining high-quality labeled data for deep learning, offering a method to improve robustness in noisy label scenarios, though it appears incremental by combining existing approaches.

The paper tackles the problem of training deep neural networks with noisy labels by improving the differentiation between clean and noisy labels and applying self-semi-supervised learning techniques, resulting in enhanced model generalization.

The remarkable success of today's deep neural networks highly depends on a massive number of correctly labeled data. However, it is rather costly to obtain high-quality human-labeled data, leading to the active research area of training models robust to noisy labels. To achieve this goal, on the one hand, many papers have been dedicated to differentiating noisy labels from clean ones to increase the generalization of DNN. On the other hand, the increasingly prevalent methods of self-semi-supervised learning have been proven to benefit the tasks when labels are incomplete. By 'semi' we regard the wrongly labeled data detected as un-labeled data; by 'self' we choose a self-supervised technique to conduct semi-supervised learning. In this project, we designed methods to more accurately differentiate clean and noisy labels and borrowed the wisdom of self-semi-supervised learning to train noisy labeled data.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes