CLJun 24, 2020

A High-Quality Multilingual Dataset for Structured Documentation Translation

arXiv:2006.13425v11094 citations
Originality Incremental advance
AI Analysis

This work addresses the localization of structured text for software documentation, providing a domain-specific dataset that enables research in multilingual translation with structured data.

The paper tackles the problem of translating structured documentation by introducing a high-quality multilingual dataset of XML-structured parallel text segments from enterprise software documentation, showing that learning with XML tags improves translation accuracy and that beam search accurately generates XML structures.

This paper presents a high-quality multilingual dataset for the documentation domain to advance research on localization of structured text. Unlike widely-used datasets for translation of plain text, we collect XML-structured parallel text segments from the online documentation for an enterprise software platform. These Web pages have been professionally translated from English into 16 languages and maintained by domain experts, and around 100,000 text segments are available for each language pair. We build and evaluate translation models for seven target languages from English, with several different copy mechanisms and an XML-constrained beam search. We also experiment with a non-English pair to show that our dataset has the potential to explicitly enable $17 \times 16$ translation settings. Our experiments show that learning to translate with the XML tags improves translation accuracy, and the beam search accurately generates XML structures. We also discuss trade-offs of using the copy mechanisms by focusing on translation of numerical words and named entities. We further provide a detailed human analysis of gaps between the model output and human translations for real-world applications, including suitability for post-editing.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes