Algebraic Machine Learning: Learning as computing an algebraic decomposition of a task
This work introduces a novel algebraic framework for machine learning, offering a fresh perspective on learning principles with potential applications in both data-driven and formal tasks, though it appears incremental in performance compared to existing methods.
The authors proposed an algebraic foundation for machine learning, where tasks and data are encoded as axioms of an algebra, and models are derived from algebraic decompositions. They validated this approach on standard datasets like MNIST and CIFAR-10, achieving performance comparable to optimized multilayer perceptrons, and extended it to formal problems such as finding Hamiltonian cycles without search.
Statistics and Optimization are foundational to modern Machine Learning. Here, we propose an alternative foundation based on Abstract Algebra, with mathematics that facilitates the analysis of learning. In this approach, the goal of the task and the data are encoded as axioms of an algebra, and a model is obtained where only these axioms and their logical consequences hold. Although this is not a generalizing model, we show that selecting specific subsets of its breakdown into algebraic atoms obtained via subdirect decomposition gives a model that generalizes. We validate this new learning principle on standard datasets such as MNIST, FashionMNIST, CIFAR-10, and medical images, achieving performance comparable to optimized multilayer perceptrons. Beyond data-driven tasks, the new learning principle extends to formal problems, such as finding Hamiltonian cycles from their specifications and without relying on search. This algebraic foundation offers a fresh perspective on machine intelligence, featuring direct learning from training data without the need for validation dataset, scaling through model additivity, and asymptotic convergence to the underlying rule in the data.