Gravitational Clustering
This addresses the challenge of classification with limited data and many classes, though it appears incremental as it builds on clustering methods.
The paper tackles the problem of supervised learning with small datasets and many classes by introducing Gravitational Clustering, which automatically builds clusters without needing an initial number and requires few samples while avoiding overfitting.
The downfall of many supervised learning algorithms, such as neural networks, is the inherent need for a large amount of training data. Although there is a lot of buzz about big data, there is still the problem of doing classification from a small dataset. Other methods such as support vector machines, although capable of dealing with few samples, are inherently binary classifiers, and are in need of learning strategies such as One vs All in the case of multi-classification. In the presence of a large number of classes this can become problematic. In this paper we present, a novel approach to supervised learning through the method of clustering. Unlike traditional methods such as K-Means, Gravitational Clustering does not require the initial number of clusters, and automatically builds the clusters, individual samples can be arbitrarily weighted and it requires only few samples while staying resilient to over-fitting.