Continual Adaptation for Pacific Indigenous Speech Recognition
This addresses the challenge of speech recognition for underrepresented Pacific Indigenous language communities, though it is an incremental study focusing on empirical analysis rather than proposing new solutions.
The paper tackled the problem of adapting speech foundation models to low-resource Pacific Indigenous languages, finding that adaptation causes severe representational drift and catastrophic forgetting, with LoRA performing well initially but failing in sequential learning.
Speech foundation models struggle with low-resource Pacific Indigenous languages because of severe data scarcity. Furthermore, full fine-tuning risks catastrophic forgetting. To address this gap, we present an empirical study adapting models to real-world Pacific datasets. We investigate how data volume and linguistic features affect adaptation success. Specifically, we evaluate strategies including Full Fine-Tuning and Low-Rank Adaptation (LoRA). Additionally, we analyze a continual learning framework for sequentially acquiring multiple languages. We demonstrate that adapting to these distant languages causes severe internal representational drift. Consequently, these models face a strict plasticity and stability dilemma. While LoRA adapts well initially, it suffers from catastrophic forgetting during sequential learning. Ultimately, this study highlights the urgent need for robust adaptation strategies tailored to underrepresented languages.