Low-Bit Data Processing Using Multiple-Output Spiking Neurons with Non-linear Reset Feedback
This work addresses the problem of improving energy-efficient neuromorphic computing for researchers and engineers by incrementally bridging SNNs and SSMs.
The authors tackled the challenge of combining the low-bit data processing of spiking neural networks (SNNs) with the performance of deep state-space models (SSMs) by proposing a novel multiple-output spiking neuron model with non-linear reset feedback. They achieved performance comparable to existing SNN benchmarks on tasks like keyword spotting and event-based vision, demonstrating that the reset mechanism enables learning even with unstable linear dynamics.
Neuromorphic computing is an emerging technology enabling low-latency and energy-efficient signal processing. A key algorithmic tool in neuromorphic computing is spiking neural networks (SNNs). SNNs are biologically inspired neural networks which utilize stateful neurons, and provide low-bit data processing by encoding and decoding information using spikes. Similar to SNNs, deep state-space models (SSMs) utilize stateful building blocks. However, deep SSMs, which recently achieved competitive performance in various temporal modeling tasks, are typically designed with high-precision activation functions and no reset mechanisms. To bridge the gains offered by SNNs and the recent deep SSM models, we propose a novel multiple-output spiking neuron model that combines a linear, general SSM state transition with a non-linear feedback mechanism through reset. Compared to the existing neuron models for SNNs, our proposed model clearly conceptualizes the differences between the spiking function, the reset condition and the reset action. The experimental results on various tasks, i.e., a keyword spotting task, an event-based vision task and a sequential pattern recognition task, show that our proposed model achieves performance comparable to existing benchmarks in the SNN literature. Our results illustrate how the proposed reset mechanism can overcome instability and enable learning even when the linear part of neuron dynamics is unstable, allowing us to go beyond the strictly enforced stability of linear dynamics in recent deep SSM models.