Effects of Introducing Synaptic Scaling on Spiking Neural Network Learning
This work addresses performance enhancement in spiking neural networks for AI applications, but it is incremental as it builds on existing plasticity methods.
The study investigated the impact of synaptic scaling on spiking neural network learning, finding that L2-norm-based synaptic scaling improved classification accuracy to 88.84% on MNIST and 68.01% on Fashion-MNIST after one epoch.
Spiking neural networks (SNNs) employing unsupervised learning methods inspired by neural plasticity are expected to be a new framework for artificial intelligence. In this study, we investigated the effect of multiple types of neural plasticity, such as spike-time-dependent plasticity (STDP) and synaptic scaling, on the learning in a winner-take-all (WTA) network composed of spiking neurons. We implemented a WTA network with multiple types of neural plasticity using Python. The MNIST and the Fashion-MNIST datasets were used for training and testing. We varied the number of neurons, the time constant of STDP, and the normalization method used in synaptic scaling to compare classification accuracy. The results demonstrated that synaptic scaling based on the L2 norm was the most effective in improving classification performance. By implementing L2-norm-based synaptic scaling and setting the number of neurons in both excitatory and inhibitory layers to 400, the network achieved classification accuracies of 88.84 % on the MNIST dataset and 68.01 % on the Fashion-MNIST dataset after one epoch of training.