CVAICRLGSep 28, 2022

Feature Decoupling in Self-supervised Representation Learning for Open Set Recognition

arXiv:2209.14385v12 citationsh-index: 43
Originality Incremental advance
AI Analysis

This addresses the problem of classifying known classes while rejecting unknown ones for applications like image and malware analysis, representing an incremental improvement.

The paper tackles open set recognition by proposing a two-stage self-supervised feature decoupling method to separate content and transformation features, which outperforms others in image and malware tasks.

Assuming unknown classes could be present during classification, the open set recognition (OSR) task aims to classify an instance into a known class or reject it as unknown. In this paper, we use a two-stage training strategy for the OSR problems. In the first stage, we introduce a self-supervised feature decoupling method that finds the content features of the input samples from the known classes. Specifically, our feature decoupling approach learns a representation that can be split into content features and transformation features. In the second stage, we fine-tune the content features with the class labels. The fine-tuned content features are then used for the OSR problems. Moreover, we consider an unsupervised OSR scenario, where we cluster the content features learned from the first stage. To measure representation quality, we introduce intra-inter ratio (IIR). Our experimental results indicate that our proposed self-supervised approach outperforms others in image and malware OSR problems. Also, our analyses indicate that IIR is correlated with OSR performance.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes