Series of quasi-uniform scatterings with fast search, root systems and neural network classifications
This addresses the challenge of handling large or unknown numbers of classes in neural network classification, offering a domain-specific solution for latent space configuration.
The paper tackles the problem of constructing large, extendable vector collections for neural network latent spaces to enable classification without a classification layer and allow class extension without retraining. The result is a method that creates well-spaced vectors in minimal dimensions, leveraging combinatorial and geometric properties of Lie groups.
In this paper we describe an approach to construct large extendable collections of vectors in predefined spaces of given dimensions. These collections are useful for neural network latent space configuration and training. For classification problem with large or unknown number of classes this allows to construct classifiers without classification layer and extend the number of classes without retraining of network from the very beginning. The construction allows to create large well-spaced vector collections in spaces of minimal possible dimension. If the number of classes is known or approximately predictable, one can choose sufficient enough vector collection size. If one needs to significantly extend the number of classes, one can extend the collection in the same latent space, or to incorporate the collection into collection of higher dimensions with same spacing between vectors. Also, regular symmetric structure of constructed vector collections can significantly simplify problems of search for nearest cluster centers or embeddings in the latent space. Construction of vector collections is based on combinatorics and geometry of semi-simple Lie groups irreducible representations with highest weight.