IndieFake Dataset: A Benchmark Dataset for Audio Deepfake Detection
This addresses the problem of inadequate audio deepfake detection in diverse linguistic and cultural contexts, such as South-Asian countries, for researchers and practitioners, though it is incremental as it focuses on dataset creation.
The authors tackled the lack of diverse ethnic accents in audio deepfake detection datasets by introducing the IndieFake Dataset (IFD), which includes 27.17 hours of audio from 50 English-speaking Indian speakers, and showed that IFD outperforms ASVspoof21 (DF) and is more challenging than the In-The-Wild dataset.
Advancements in audio deepfake technology offers benefits like AI assistants, better accessibility for speech impairments, and enhanced entertainment. However, it also poses significant risks to security, privacy, and trust in digital communications. Detecting and mitigating these threats requires comprehensive datasets. Existing datasets lack diverse ethnic accents, making them inadequate for many real-world scenarios. Consequently, models trained on these datasets struggle to detect audio deepfakes in diverse linguistic and cultural contexts such as in South-Asian countries. Ironically, there is a stark lack of South-Asian speaker samples in the existing datasets despite constituting a quarter of the worlds population. This work introduces the IndieFake Dataset (IFD), featuring 27.17 hours of bonafide and deepfake audio from 50 English speaking Indian speakers. IFD offers balanced data distribution and includes speaker-level characterization, absent in datasets like ASVspoof21 (DF). We evaluated various baselines on IFD against existing ASVspoof21 (DF) and In-The-Wild (ITW) datasets. IFD outperforms ASVspoof21 (DF) and proves to be more challenging compared to benchmark ITW dataset. The complete dataset, along with documentation and sample reference clips, is publicly accessible for research use on project website.