Sigma-Delta Neural Network Conversion on Loihi 2
This work addresses the difficulty of training spiking neural networks by providing an efficient conversion method for neuromorphic hardware, benefiting edge AI applications.
The authors developed a method to convert conventional analog neural networks to spiking neural networks using graded spikes on Intel's Loihi 2, achieving significant improvements in energy-delay product over NVIDIA's Jetson Xavier edge AI platform.
Neuromorphic computing aims to improve the efficiency of artificial neural networks by taking inspiration from biological neurons and leveraging temporal sparsity, spatial sparsity, and compute near/in memory. Although these approaches have shown efficiency gains, training these spiking neural networks (SNN) remains difficult. The original attempts at converting trained conventional analog neural networks (ANN) to SNNs used the rate of binary spikes to represent neuron activations. This required many simulation time steps per inference, which degraded efficiency. Intel's Loihi 2 is a neuromorphic platform that supports graded spikes which can be used to represent changes in neuron activation. In this work, we use Loihi 2's graded spikes to develop a method for converting ANN networks to spiking networks, which exploits temporal and spatial sparsity. We evaluated the performance of this network on Loihi 2 and compared it to NVIDIA's Jetson Xavier edge AI platform. The results show that neuromorphic approaches achieve significant improvements in efficiency and latency (energy-delay product) over existing solutions.