Few-Shot Accent Synthesis for ASR with LLM-Guided Phoneme Editing
For ASR systems suffering from scarce accented data, this work provides a practical pipeline that requires minimal labeled speech, though gains are incremental over a random phoneme baseline.
The paper tackles few-shot accent synthesis for ASR, achieving WER reductions with fewer than ten reference utterances by using LLM-guided phoneme editing and TTS-based data augmentation.
Accented automatic speech recognition (ASR) often degrades due to the limited availability of accented training data. Prior work has explored accent modeling in low-resource settings, but existing approaches typically require minutes to hours of labeled speech, which may still be impractical for truly scarce accent scenarios. We propose a pipeline that adapts a text-to-speech (TTS) decoder to a target-accent speaker using fewer than ten reference utterances and employs large language model (LLM)-based phoneme editing to generate accent-conditioned pronunciations. The resulting synthetic speech is used to fine-tune a self-supervised ASR model. Experiments demonstrate consistent word error rate (WER) reductions on real accented speech, including cross-speaker evaluation and ultra-low data regimes. A matched-rate random phoneme baseline shows that phoneme-space perturbation itself is a strong form of augmentation, while LLM-guided edits provide additional gains through accent-conditioned structure.