Exploring Parameter-Efficient Fine-Tuning and Backtranslation for the WMT 25 General Translation Task
This provides a lightweight strategy for improving low-resource language translation, though it is incremental as it applies existing techniques to a specific domain.
The paper tackled neural machine translation for English→Japanese using limited data, achieving a COMET score of 0.597 by combining backtranslation and fine-tuning on a small parallel dataset, up from a baseline of 0.460.
In this paper, we explore the effectiveness of combining fine-tuning and backtranslation on a small Japanese corpus for neural machine translation. Starting from a baseline English{\textrightarrow}Japanese model (COMET = 0.460), we first apply backtranslation (BT) using synthetic data generated from monolingual Japanese corpora, yielding a modest increase (COMET = 0.468). Next, we fine-tune (FT) the model on a genuine small parallel dataset drawn from diverse Japanese news and literary corpora, achieving a substantial jump to COMET = 0.589 when using Mistral 7B. Finally, we integrate both backtranslation and fine-tuning{ -- }first augmenting the small dataset with BT generated examples, then adapting via FT{ -- }which further boosts performance to COMET = 0.597. These results demonstrate that, even with limited training data, the synergistic use of backtranslation and targeted fine-tuning on Japanese corpora can significantly enhance translation quality, outperforming each technique in isolation. This approach offers a lightweight yet powerful strategy for improving low-resource language pairs.