2.1ETJun 30
Power law scaling for classification accuracy in physical neural networksAndrei V. Ermolaev, Mathilde Hary, Anas Skalli et al.
Physical neural networks (PNNs) harness the intrinsic complexity of physical systems to perform neural computation, potentially at speeds and energy efficiencies inaccessible to conventional digital hardware. Yet, a principled framework for quantifying and predicting their computing accuracy across diverse substrates has remained elusive. Here we introduce the Hotelling Trace Criterion (HTC), a task-conditioned measure of PNN- state separability that can be evaluated without training. We demonstrate that it predicts PNN classification performance with high fidelity across highly nonlinear optical fibres, vertical-cavity surface-emitting lasers, and coupled nonlinear oscillator networks, for benchmark tasks of different difficulty. Classification loss follows a power law in HTC, with Pearson correlation coefficients exceeding 0.99 for MNIST and $\approx$0.97 for Fashion-MNIST, noteworthy experimental and simulated data from physically distinct systems collapse onto a single scaling curve determined by the task rather than the substrate. Applying HTC layer-by-layer during training further reveals that gradient-based optimisation distributes representational capacity unevenly across PNN layers, providing a quantitative diagnostic of training and architecture efficiency invisible to standard loss monitoring. Crucially, once the scaling exponent is established from a small number of trained calibration systems, all further performance predictions require no training since performance can be derived from the much more efficient HTC measurement. These results establish HTC as a substrate-agnostic figure of merit for comparing and scaling PNNs, advancing the field further towards a complete theory connecting fundamental hardware parameters to task performance through universal scaling laws.
1.2OPTICSMar 5, 2025
Limits of nonlinear and dispersive fiber propagation for an optical fiber-based extreme learning machineAndrei V. Ermolaev, Mathilde Hary, Lev Leybov et al.
We report a generalized nonlinear Schrödinger equation simulation model of an extreme learning machine (ELM) based on optical fiber propagation. Using the MNIST handwritten digit dataset as a benchmark, we study how accuracy depends on propagation dynamics, as well as parameters governing spectral encoding, readout, and noise. For this dataset and with quantum noise limited input, test accuracies of : over 91% and 93% are found for propagation in the anomalous and normal dispersion regimes respectively. Our results also suggest that quantum noise on the input pulses introduces an intrinsic penalty to ELM performance.
1.2COMP-PHMay 28, 2018
Machine learning for prediction of extreme statistics in modulation instabilityMikko Närhi, Lauri Salmela, Juha Toivonen et al.
A central area of research in nonlinear science is the study of instabilities that drive the emergence of extreme events. Unfortunately, experimental techniques for measuring such phenomena often provide only partial characterization. For example, real-time studies of instabilities in nonlinear fibre optics frequently use only spectral data, precluding detailed predictions about the associated temporal properties. Here, we show how Machine Learning can overcome this limitation by predicting statistics for the maximum intensity of temporal peaks in modulation instability based only on spectral measurements. Specifically, we train a neural network based Machine Learning model to correlate spectral and temporal properties of optical fibre modulation instability using data from numerical simulations, and we then use this model to predict the temporal probability distribution based on high-dynamic range spectral data from experiments. These results open novel perspectives in all systems exhibiting chaos and instability where direct time-domain observations are difficult.