GarmentSketch: Large-scale Sketch-to-Fashion Benchmark
For researchers in sketch-based fashion image synthesis, this dataset fills a gap by providing a large-scale, high-quality paired resource, though the contribution is primarily dataset creation.
The paper introduces GarmentSketch, a large-scale dataset of 26,249 fashion sketches paired with textual descriptions, and benchmarks existing generative models on sketch-guided text-to-image generation, revealing current limitations.
Fashion sketching is a cornerstone of design workflows, allowing rapid visualization of creative concepts prior to physical prototyping. Yet, progress in sketch-based fashion image synthesis has been hindered by the absence of large-scale, high-quality paired resources. To bridge this gap, we present GarmentSketch, a novel dataset comprising 26,249 fashion sketches across 21 garment categories, each paired with detailed textual descriptions. Captions were produced through a multi-stage pipeline that integrates multiple multimodal large language models (MLLMs) with human-in-the-loop refinement, ensuring both semantic accuracy and descriptive richness. We benchmark GarmentSketch on state-of-the-art generative models, providing baseline performance for sketch-guided text-to-image generation. Our experiments reveal both the promise and the current limitations of existing methods. By offering a comprehensive and richly annotated resource, GarmentSketch establishes a foundation for advancing sketch understanding, fine-grained fashion image generation, and creative human-AI collaboration in design. The dataset will be available at: https://khangbdd.github.io/garmentsketch.