Keyword Spotting with Hyper-Matched Filters for Small Footprint Devices
This addresses efficient and robust keyword detection for resource-constrained devices, with incremental improvements in method and performance.
The paper tackles open-vocabulary keyword spotting for small-footprint devices by introducing a model with a hyper-network that generates keyword-specific matched filters, achieving state-of-the-art detection accuracy and generalizing to out-of-domain conditions like second-language speech, with a 4.2 million parameter model matching or outperforming larger models.
Open-vocabulary keyword spotting (KWS) refers to the task of detecting words or terms within speech recordings, regardless of whether they were included in the training data. This paper introduces an open-vocabulary keyword spotting model with state-of-the-art detection accuracy for small-footprint devices. The model is composed of a speech encoder, a target keyword encoder, and a detection network. The speech encoder is either a tiny Whisper or a tiny Conformer. The target keyword encoder is implemented as a hyper-network that takes the desired keyword as a character string and generates a unique set of weights for a convolutional layer, which can be considered as a keyword-specific matched filter. The detection network uses the matched-filter weights to perform a keyword-specific convolution, which guides the cross-attention mechanism of a Perceiver module in determining whether the target term appears in the recording. The results indicate that our system achieves state-of-the-art detection performance and generalizes effectively to out-of-domain conditions, including second-language (L2) speech. Notably, our smallest model, with just 4.2 million parameters, matches or outperforms models that are several times larger, demonstrating both efficiency and robustness.