Forearm Ultrasound based Gesture Recognition on Edge
This enables efficient, real-time gesture recognition for wearable systems, though it is incremental as it applies existing methods to a new application.
The paper tackled deploying deep neural networks for forearm ultrasound-based hand gesture recognition on edge devices, achieving 92% test accuracy and 0.31-second inference time on a Raspberry Pi with quantization techniques.
Ultrasound imaging of the forearm has demonstrated significant potential for accurate hand gesture classification. Despite this progress, there has been limited focus on developing a stand-alone end- to-end gesture recognition system which makes it mobile, real-time and more user friendly. To bridge this gap, this paper explores the deployment of deep neural networks for forearm ultrasound-based hand gesture recognition on edge devices. Utilizing quantization techniques, we achieve substantial reductions in model size while maintaining high accuracy and low latency. Our best model, with Float16 quantization, achieves a test accuracy of 92% and an inference time of 0.31 seconds on a Raspberry Pi. These results demonstrate the feasibility of efficient, real-time gesture recognition on resource-limited edge devices, paving the way for wearable ultrasound-based systems.