CVApr 24, 2018

Real-Time Human Detection as an Edge Service Enabled by a Lightweight CNN

arXiv:1805.00330v1133 citations
Originality Incremental advance
AI Analysis

This addresses the need for efficient, delay-sensitive human detection in smart surveillance, though it is incremental as it adapts existing methods for edge constraints.

The paper tackles the problem of real-time human detection on resource-limited edge devices by introducing a lightweight CNN (LCNN) based on depthwise separable convolution and SSD, achieving satisfactory performance on a Raspberry Pi 3 with real-world surveillance video streams.

Edge computing allows more computing tasks to take place on the decentralized nodes at the edge of networks. Today many delay sensitive, mission-critical applications can leverage these edge devices to reduce the time delay or even to enable real time, online decision making thanks to their onsite presence. Human objects detection, behavior recognition and prediction in smart surveillance fall into that category, where a transition of a huge volume of video streaming data can take valuable time and place heavy pressure on communication networks. It is widely recognized that video processing and object detection are computing intensive and too expensive to be handled by resource limited edge devices. Inspired by the depthwise separable convolution and Single Shot Multi-Box Detector (SSD), a lightweight Convolutional Neural Network (LCNN) is introduced in this paper. By narrowing down the classifier's searching space to focus on human objects in surveillance video frames, the proposed LCNN algorithm is able to detect pedestrians with an affordable computation workload to an edge device. A prototype has been implemented on an edge node (Raspberry PI 3) using openCV libraries, and satisfactory performance is achieved using real world surveillance video streams. The experimental study has validated the design of LCNN and shown it is a promising approach to computing intensive applications at the edge.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes