Evaluation of Deep Learning on an Abstract Image Classification Dataset
This work addresses the gap in image classification datasets for abstract classes, which is an incremental step for researchers in computer vision and AI.
The paper tackles the problem of evaluating deep learning on abstract image classification, where humans perform well but CNNs struggle, by presenting a novel dataset and testing popular CNN architectures on it, identifying variations for further research.
Convolutional Neural Networks have become state of the art methods for image classification over the last couple of years. By now they perform better than human subjects on many of the image classification datasets. Most of these datasets are based on the notion of concrete classes (i.e. images are classified by the type of object in the image). In this paper we present a novel image classification dataset, using abstract classes, which should be easy to solve for humans, but variations of it are challenging for CNNs. The classification performance of popular CNN architectures is evaluated on this dataset and variations of the dataset that might be interesting for further research are identified.