Empowering Vector Graphics with Consistently Arbitrary Viewing and View-dependent Visibility
This addresses the problem of generating consistent 3D vector graphics from text prompts for applications in design and visualization, representing a novel method for a known bottleneck.
The paper tackles text-to-3D vector graphics generation by proposing Dream3DVG, a dual-branch optimization framework that enables arbitrary viewpoint viewing, progressive detail control, and view-dependent occlusion awareness. Results show superiority in cross-view consistency and occlusion-aware stroke culling on 3D sketches and iconographies.
This work presents a novel text-to-vector graphics generation approach, Dream3DVG, allowing for arbitrary viewpoint viewing, progressive detail optimization, and view-dependent occlusion awareness. Our approach is a dual-branch optimization framework, consisting of an auxiliary 3D Gaussian Splatting optimization branch and a 3D vector graphics optimization branch. The introduced 3DGS branch can bridge the domain gaps between text prompts and vector graphics with more consistent guidance. Moreover, 3DGS allows for progressive detail control by scheduling classifier-free guidance, facilitating guiding vector graphics with coarse shapes at the initial stages and finer details at later stages. We also improve the view-dependent occlusions by devising a visibility-awareness rendering module. Extensive results on 3D sketches and 3D iconographies, demonstrate the superiority of the method on different abstraction levels of details, cross-view consistency, and occlusion-aware stroke culling.