JaParaPat: A Large-Scale Japanese-English Parallel Patent Application Corpus
This provides a valuable resource for researchers and practitioners in machine translation, particularly for domain-specific applications in patent processing, though it is incremental as it builds on existing methods for corpus construction.
The authors tackled the problem of limited bilingual data for Japanese-English patent translation by constructing JaParaPat, a large-scale parallel corpus of over 300 million sentence pairs from patent applications, which improved translation accuracy by 20 BLEU points when added to existing web data.
We constructed JaParaPat (Japanese-English Parallel Patent Application Corpus), a bilingual corpus of more than 300 million Japanese-English sentence pairs from patent applications published in Japan and the United States from 2000 to 2021. We obtained the publication of unexamined patent applications from the Japan Patent Office (JPO) and the United States Patent and Trademark Office (USPTO). We also obtained patent family information from the DOCDB, that is a bibliographic database maintained by the European Patent Office (EPO). We extracted approximately 1.4M Japanese-English document pairs, which are translations of each other based on the patent families, and extracted about 350M sentence pairs from the document pairs using a translation-based sentence alignment method whose initial translation model is bootstrapped from a dictionary-based sentence alignment method. We experimentally improved the accuracy of the patent translations by 20 bleu points by adding more than 300M sentence pairs obtained from patent applications to 22M sentence pairs obtained from the web.