CVApr 29, 2022

A Challenging Benchmark of Anime Style Recognition

arXiv:2204.14034v29 citationsh-index: 26Has Code
Originality Synthesis-oriented
AI Analysis

This work addresses the challenging problem of anime style recognition for researchers in computer vision, but it is incremental as it primarily introduces a new benchmark without proposing a novel method.

The authors tackled the problem of anime style recognition (ASR) by creating a large-scale benchmark dataset (LSASRD) with 20,937 images from 190 anime works, and they found that a state-of-the-art transformer model achieved only 42.24% mAP, highlighting the task's difficulty.

Given two images of different anime roles, anime style recognition (ASR) aims to learn abstract painting style to determine whether the two images are from the same work, which is an interesting but challenging problem. Unlike biometric recognition, such as face recognition, iris recognition, and person re-identification, ASR suffers from a much larger semantic gap but receives less attention. In this paper, we propose a challenging ASR benchmark. Firstly, we collect a large-scale ASR dataset (LSASRD), which contains 20,937 images of 190 anime works and each work at least has ten different roles. In addition to the large-scale, LSASRD contains a list of challenging factors, such as complex illuminations, various poses, theatrical colors and exaggerated compositions. Secondly, we design a cross-role protocol to evaluate ASR performance, in which query and gallery images must come from different roles to validate an ASR model is to learn abstract painting style rather than learn discriminative features of roles. Finally, we apply two powerful person re-identification methods, namely, AGW and TransReID, to construct the baseline performance on LSASRD. Surprisingly, the recent transformer model (i.e., TransReID) only acquires a 42.24% mAP on LSASRD. Therefore, we believe that the ASR task of a huge semantic gap deserves deep and long-term research. We will open our dataset and code at https://github.com/nkjcqvcpi/ASR.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes