DNA: Dual-branch Network with Adaptation for Open-Set Online Handwriting Generation
This work addresses a limitation in handwriting synthesis for real-world applications, but it appears incremental as it builds on existing OHG methods with novel adaptations.
The paper tackled the problem of generating unseen characters in online handwriting generation, particularly for glyph-based languages like Chinese, by proposing a Dual-branch Network with Adaptation (DNA) that achieved state-of-the-art performance.
Online handwriting generation (OHG) enhances handwriting recognition models by synthesizing diverse, human-like samples. However, existing OHG methods struggle to generate unseen characters, particularly in glyph-based languages like Chinese, limiting their real-world applicability. In this paper, we introduce our method for OHG, where the writer's style and the characters generated during testing are unseen during training. To tackle this challenge, we propose a Dual-branch Network with Adaptation (DNA), which comprises an adaptive style branch and an adaptive content branch. The style branch learns stroke attributes such as writing direction, spacing, placement, and flow to generate realistic handwriting. Meanwhile, the content branch is designed to generalize effectively to unseen characters by decomposing character content into structural information and texture details, extracted via local and global encoders, respectively. Extensive experiments demonstrate that our DNA model is well-suited for the unseen OHG setting, achieving state-of-the-art performance.