OHARCVNESPNov 21, 2017

Design Automation for Binarized Neural Networks: A Quantum Leap Opportunity?

arXiv:1712.01743v121 citations
Originality Incremental advance
AI Analysis

This work addresses the problem of enabling efficient deep learning circuits for sensor applications, though it is incremental as it builds on existing BNN techniques.

The paper tackled the design of ultra-low power near-sensor processing by implementing a combinational Binarized Neural Network (BNN) with fixed weights, achieving a 2.2x smaller silicon area and 10x higher energy efficiency compared to other methods.

Design automation in general, and in particular logic synthesis, can play a key role in enabling the design of application-specific Binarized Neural Networks (BNN). This paper presents the hardware design and synthesis of a purely combinational BNN for ultra-low power near-sensor processing. We leverage the major opportunities raised by BNN models, which consist mostly of logical bit-wise operations and integer counting and comparisons, for pushing ultra-low power deep learning circuits close to the sensor and coupling it with binarized mixed-signal image sensor data. We analyze area, power and energy metrics of BNNs synthesized as combinational networks. Our synthesis results in GlobalFoundries 22nm SOI technology shows a silicon area of 2.61mm2 for implementing a combinational BNN with 32x32 binary input sensor receptive field and weight parameters fixed at design time. This is 2.2x smaller than a synthesized network with re-configurable parameters. With respect to other comparable techniques for deep learning near-sensor processing, our approach features a 10x higher energy efficiency.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes