SynthDoc: Bilingual Documents Synthesis for Visual Document Understanding
This provides a scalable solution to data acquisition challenges for the VDU community, though it is incremental as it builds on existing methods for synthetic data generation.
The paper tackles the problem of data scarcity in Visual Document Understanding by introducing SynthDoc, a synthetic document generation pipeline that creates high-quality datasets; experiments with the Donut model show it achieves superior performance in pre-training and robustness in downstream tasks, with a released benchmark of 5,000 image-text pairs.
This paper introduces SynthDoc, a novel synthetic document generation pipeline designed to enhance Visual Document Understanding (VDU) by generating high-quality, diverse datasets that include text, images, tables, and charts. Addressing the challenges of data acquisition and the limitations of existing datasets, SynthDoc leverages publicly available corpora and advanced rendering tools to create a comprehensive and versatile dataset. Our experiments, conducted using the Donut model, demonstrate that models trained with SynthDoc's data achieve superior performance in pre-training read tasks and maintain robustness in downstream tasks, despite language inconsistencies. The release of a benchmark dataset comprising 5,000 image-text pairs not only showcases the pipeline's capabilities but also provides a valuable resource for the VDU community to advance research and development in document image recognition. This work significantly contributes to the field by offering a scalable solution to data scarcity and by validating the efficacy of end-to-end models in parsing complex, real-world documents.