No Pitch Left Behind: Addressing Gender Unbalance in Automatic Speech Recognition through Pitch Manipulation
This addresses gender disparities in ASR accuracy, which is a domain-specific problem for users of speech recognition systems, though it is incremental as it builds on existing data augmentation methods.
The paper tackled gender bias in automatic speech recognition (ASR) by proposing a data augmentation technique that manipulates pitch and formants to simulate underrepresented female voices, resulting in up to a 9.87% relative WER improvement for female speakers.
Automatic speech recognition (ASR) systems are known to be sensitive to the sociolinguistic variability of speech data, in which gender plays a crucial role. This can result in disparities in recognition accuracy between male and female speakers, primarily due to the under-representation of the latter group in the training data. While in the context of hybrid ASR models several solutions have been proposed, the gender bias issue has not been explicitly addressed in end-to-end neural architectures. To fill this gap, we propose a data augmentation technique that manipulates the fundamental frequency (f0) and formants. This technique reduces the data unbalance among genders by simulating voices of the under-represented female speakers and increases the variability within each gender group. Experiments on spontaneous English speech show that our technique yields a relative WER improvement up to 9.87% for utterances by female speakers, with larger gains for the least-represented f0 ranges.