Speaker Tagging Correction With Non-Autoregressive Language Models
This addresses speaker diarization errors for speech recognition systems, but it is incremental as it builds on existing methods for error correction.
The paper tackled the problem of correcting speaker tagging errors in speech applications by using a non-autoregressive language model to fix mistakes at sentence borders, resulting in reductions in word diarization error rate on TAL and Fisher datasets and improvements in cpWER in a challenge.
Speech applications dealing with conversations require not only recognizing the spoken words but also determining who spoke when. The task of assigning words to speakers is typically addressed by merging the outputs of two separate systems, namely, an automatic speech recognition (ASR) system and a speaker diarization (SD) system. In practical settings, speaker diarization systems can experience significant degradation in performance due to a variety of factors, including uniform segmentation with a high temporal resolution, inaccurate word timestamps, incorrect clustering and estimation of speaker numbers, as well as background noise. Therefore, it is important to automatically detect errors and make corrections if possible. We used a second-pass speaker tagging correction system based on a non-autoregressive language model to correct mistakes in words placed at the borders of sentences spoken by different speakers. We first show that the employed error correction approach leads to reductions in word diarization error rate (WDER) on two datasets: TAL and test set of Fisher. Additionally, we evaluated our system in the Post-ASR Speaker Tagging Correction challenge and observed significant improvements in cpWER compared to baseline methods.