Tiny Noise-Robust Voice Activity Detector for Voice Assistants
This work addresses the challenge of accurate voice detection in noisy settings for voice assistants on resource-constrained devices, representing an incremental improvement over existing methods.
The paper tackles the problem of voice activity detection in noisy environments for voice assistants on AIoT devices, proposing a lightweight model with pre- and post-processing modules that significantly enhances accuracy without increasing model size or fine-tuning, achieving notable improvements over baselines in high-noise conditions.
Voice Activity Detection (VAD) in the presence of background noise remains a challenging problem in speech processing. Accurate VAD is essential in automatic speech recognition, voice-to-text, conversational agents, etc, where noise can severely degrade the performance. A modern application includes the voice assistant, specially mounted on Artificial Intelligence of Things (AIoT) devices such as cell phones, smart glasses, earbuds, etc, where the voice signal includes background noise. Therefore, VAD modules must remain light-weight due to their practical on-device limitation. The existing models often struggle with low signal-to-noise ratios across diverse acoustic environments. A simple VAD often detects human voice in a clean environment, but struggles to detect the human voice in noisy conditions. We propose a noise-robust VAD that comprises a light-weight VAD, with data pre-processing and post-processing added modules to handle the background noise. This approach significantly enhances the VAD accuracy in noisy environments and requires neither a larger model, nor fine-tuning. Experimental results demonstrate that our approach achieves a notable improvement compared to baselines, particularly in environments with high background noise interference. This modified VAD additionally improving clean speech detection.