BED: A Real-Time Object Detection System for Edge Devices
This provides an efficient solution for real-time object detection on edge devices, though it is incremental as it builds on existing DNN acceleration techniques.
The paper tackles the challenge of deploying deep neural networks on edge devices with limited resources by presenting BED, a real-time object detection system that achieves accurate detection with a 300-KB model, 91.9 ms inference time, and 1.845 mJ energy consumption.
Deploying deep neural networks~(DNNs) on edge devices provides efficient and effective solutions for the real-world tasks. Edge devices have been used for collecting a large volume of data efficiently in different domains. DNNs have been an effective tool for data processing and analysis. However, designing DNNs on edge devices is challenging due to the limited computational resources and memory. To tackle this challenge, we demonstrate Object Detection System for Edge Devices~(BED) on the MAX78000 DNN accelerator. It integrates on-device DNN inference with a camera and an LCD display for image acquisition and detection exhibition, respectively. BED is a concise, effective and detailed solution, including model training, quantization, synthesis and deployment. The entire repository is open-sourced on Github, including a Graphical User Interface~(GUI) for on-chip debugging. Experiment results indicate that BED can produce accurate detection with a 300-KB tiny DNN model, which takes only 91.9 ms of inference time and 1.845 mJ of energy. The real-time detection is available at YouTube.