Time Resolution Dependence of Information Measures for Spiking Neurons: Atoms, Scaling, and Universality
This work addresses the problem of refining neural coding analysis for computational neuroscientists, offering tools to reveal mechanistic details and aid model selection, though it appears incremental in extending existing information-theoretic approaches.
The study investigated how information measures for spiking neurons, such as entropy rate and statistical complexity, depend on time resolution, revealing structural properties like interspike interval correlations and universality in integrate-and-fire models. It found that these measures diverge less quickly than firing rates in some cases and show universal behavior in continuous-time limits, suggesting simplicity in spike train generation.
The mutual information between stimulus and spike-train response is commonly used to monitor neural coding efficiency, but neuronal computation broadly conceived requires more refined and targeted information measures of input-output joint processes. A first step towards that larger goal is to develop information measures for individual output processes, including information generation (entropy rate), stored information (statistical complexity), predictable information (excess entropy), and active information accumulation (bound information rate). We calculate these for spike trains generated by a variety of noise-driven integrate-and-fire neurons as a function of time resolution and for alternating renewal processes. We show that their time-resolution dependence reveals coarse-grained structural properties of interspike interval statistics; e.g., $τ$-entropy rates that diverge less quickly than the firing rate indicate interspike interval correlations. We also find evidence that the excess entropy and regularized statistical complexity of different types of integrate-and-fire neurons are universal in the continuous-time limit in the sense that they do not depend on mechanism details. This suggests a surprising simplicity in the spike trains generated by these model neurons. Interestingly, neurons with gamma-distributed ISIs and neurons whose spike trains are alternating renewal processes do not fall into the same universality class. These results lead to two conclusions. First, the dependence of information measures on time resolution reveals mechanistic details about spike train generation. Second, information measures can be used as model selection tools for analyzing spike train processes.