Latent Dirichlet Allocation Based Acoustic Data Selection for Automatic Speech Recognition
This work addresses data selection for speech recognition, offering a domain-specific improvement that is incremental over existing methods.
The paper tackles the problem of selecting in-domain acoustic data for automatic speech recognition by proposing a method using acoustic Latent Dirichlet Allocation (aLDA) as a similarity criterion, which significantly outperforms random selection, posterior-based selection, and using all available data on a target dataset of 32 hours of meeting data.
Selecting in-domain data from a large pool of diverse and out-of-domain data is a non-trivial problem. In most cases simply using all of the available data will lead to sub-optimal and in some cases even worse performance compared to carefully selecting a matching set. This is true even for data-inefficient neural models. Acoustic Latent Dirichlet Allocation (aLDA) is shown to be useful in a variety of speech technology related tasks, including domain adaptation of acoustic models for automatic speech recognition and entity labeling for information retrieval. In this paper we propose to use aLDA as a data similarity criterion in a data selection framework. Given a large pool of out-of-domain and potentially mismatched data, the task is to select the best-matching training data to a set of representative utterances sampled from a target domain. Our target data consists of around 32 hours of meeting data (both far-field and close-talk) and the pool contains 2k hours of meeting, talks, voice search, dictation, command-and-control, audio books, lectures, generic media and telephony speech data. The proposed technique for training data selection, significantly outperforms random selection, posterior-based selection as well as using all of the available data.