CLOct 23, 2021

PhoMT: A High-Quality and Large-Scale Benchmark Dataset for Vietnamese-English Machine Translation

arXiv:2110.12199v1663 citations
Originality Incremental advance
AI Analysis

This provides a foundational resource for Vietnamese-English machine translation research and applications, addressing a gap in the field.

The authors tackled the lack of a large-scale Vietnamese-English machine translation dataset by creating PhoMT, a high-quality parallel dataset of 3.02M sentence pairs, and found that fine-tuning mBART achieved the best performance in evaluations.

We introduce a high-quality and large-scale Vietnamese-English parallel dataset of 3.02M sentence pairs, which is 2.9M pairs larger than the benchmark Vietnamese-English machine translation corpus IWSLT15. We conduct experiments comparing strong neural baselines and well-known automatic translation engines on our dataset and find that in both automatic and human evaluations: the best performance is obtained by fine-tuning the pre-trained sequence-to-sequence denoising auto-encoder mBART. To our best knowledge, this is the first large-scale Vietnamese-English machine translation study. We hope our publicly available dataset and study can serve as a starting point for future research and applications on Vietnamese-English machine translation.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes