Multimodal Latent Diffusion Model for Complex Sewing Pattern Generation
This addresses a domain-specific problem for garment designers and CG artists by enabling more intricate and body-suited sewing pattern generation, though it appears incremental as an extension of existing diffusion models to a new application.
The paper tackles the problem of generating complex sewing patterns with detailed control in garment design by proposing SewingLDM, a multimodal generative model that uses text prompts, body shapes, and garment sketches as conditions; it significantly surpasses previous approaches in complex garment design and body adaptability.
Generating sewing patterns in garment design is receiving increasing attention due to its CG-friendly and flexible-editing nature. Previous sewing pattern generation methods have been able to produce exquisite clothing, but struggle to design complex garments with detailed control. To address these issues, we propose SewingLDM, a multi-modal generative model that generates sewing patterns controlled by text prompts, body shapes, and garment sketches. Initially, we extend the original vector of sewing patterns into a more comprehensive representation to cover more intricate details and then compress them into a compact latent space. To learn the sewing pattern distribution in the latent space, we design a two-step training strategy to inject the multi-modal conditions, \ie, body shapes, text prompts, and garment sketches, into a diffusion model, ensuring the generated garments are body-suited and detail-controlled. Comprehensive qualitative and quantitative experiments show the effectiveness of our proposed method, significantly surpassing previous approaches in terms of complex garment design and various body adaptability. Our project page: https://shengqiliu1.github.io/SewingLDM.