CzechDocs: A Multiway Parallel Dataset of Formatted Documents for Minority Languages in Czechia
This dataset addresses the need for evaluating machine translation systems that preserve document formatting, particularly for minority languages, but the contribution is incremental as it primarily provides a new benchmark.
The paper introduces CzechDocs, a multiway parallel dataset of formatted documents (HTML, DOCX, PDF) for Czech and minority languages in Czechia, and provides a comparison of format-preserving machine translation approaches on a validation subset.
We present CzechDocs, a multiway parallel dataset of formatted documents (HTML, DOCX, and PDF) covering Czech and minority languages used in Czechia-primarily Ukrainian and English, with smaller portions of Vietnamese, Russian and other languages. The dataset is designed to support the evaluation of machine translation systems that aim to preserve document formatting during translation. We provide a comparison of the most common approaches to format-preserving machine translation on a validation subset of the dataset. This validation split, together with the evaluation toolkit, is publicly released for further research. A held-out test split will be reserved for a future shared task focused on document-level translation with formatting preservation.