ETLGOPTICSMay 18, 2022

Single-Shot Optical Neural Network

arXiv:2205.09103v273 citationsh-index: 62
Originality Highly original
AI Analysis

This work addresses the problem of inefficient computing for next-generation DNNs by enabling highly efficient optical processing, representing a novel method for a known bottleneck rather than a foundational breakthrough.

The authors tackled the latency and power limitations of digital processors for deep neural networks by developing a scalable, single-shot-per-layer analog optical processor that achieves 94.7% accuracy on MNIST without retraining, with a throughput bound of ~0.9 exaMAC/s.

As deep neural networks (DNNs) grow to solve increasingly complex problems, they are becoming limited by the latency and power consumption of existing digital processors. For improved speed and energy efficiency, specialized analog optical and electronic hardware has been proposed, however, with limited scalability (input vector length $K$ of hundreds of elements). Here, we present a scalable, single-shot-per-layer analog optical processor that uses free-space optics to reconfigurably distribute an input vector and integrated optoelectronics for static, updatable weighting and the nonlinearity -- with $K \approx 1,000$ and beyond. We experimentally test classification accuracy of the MNIST handwritten digit dataset, achieving 94.7% (ground truth 96.3%) without data preprocessing or retraining on the hardware. We also determine the fundamental upper bound on throughput ($\sim$0.9 exaMAC/s), set by the maximum optical bandwidth before significant increase in error. Our combination of wide spectral and spatial bandwidths in a CMOS-compatible system enables highly efficient computing for next-generation DNNs.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes