Microphone Conversion: Mitigating Device Variability in Sound Event Classification
This addresses the problem of limited device diversity in training data for sound event classification systems, which is incremental as it builds on existing methods.
The paper tackles device variability in sound event classification by introducing a CycleGAN-based augmentation technique, resulting in a 5.2% - 11.5% improvement in generalization and a 6.5% - 12.8% gain in adaptability across devices.
In this study, we introduce a new augmentation technique to enhance the resilience of sound event classification (SEC) systems against device variability through the use of CycleGAN. We also present a unique dataset to evaluate this method. As SEC systems become increasingly common, it is crucial that they work well with audio from diverse recording devices. Our method addresses limited device diversity in training data by enabling unpaired training to transform input spectrograms as if they are recorded on a different device. Our experiments show that our approach outperforms existing methods in generalization by 5.2% - 11.5% in weighted f1 score. Additionally, it surpasses the current methods in adaptability across diverse recording devices by achieving a 6.5% - 12.8% improvement in weighted f1 score.