Domain Specific Wav2vec 2.0 Fine-tuning For The SE&R 2022 Challenge
This work addresses ASR for Portuguese speech, including spontaneous and prepared dialects, but is incremental as it builds on existing methods for a specific challenge.
The paper tackled automatic speech recognition for Portuguese by fine-tuning a wav2vec 2.0 model with domain-specific techniques, achieving improvements over a strong baseline in 3 out of 4 challenge tracks.
This paper presents our efforts to build a robust ASR model for the shared task Automatic Speech Recognition for spontaneous and prepared speech & Speech Emotion Recognition in Portuguese (SE&R 2022). The goal of the challenge is to advance the ASR research for the Portuguese language, considering prepared and spontaneous speech in different dialects. Our method consist on fine-tuning an ASR model in a domain-specific approach, applying gain normalization and selective noise insertion. The proposed method improved over the strong baseline provided on the test set in 3 of the 4 tracks available