Chat-to-Design: AI Assisted Personalized Fashion Design
This addresses the problem of limited personalization in fashion design for users, though it appears incremental as it combines existing techniques like retrieval and generative editing.
The paper tackles personalized fashion design by introducing Chat-to-Design, a multimodal system that allows users to design clothes through conversation and interactive editing, resulting in an immersive experience.
In this demo, we present Chat-to-Design, a new multimodal interaction system for personalized fashion design. Compared to classic systems that recommend apparel based on keywords, Chat-to-Design enables users to design clothes in two steps: 1) coarse-grained selection via conversation and 2) fine-grained editing via an interactive interface. It encompasses three sub-systems to deliver an immersive user experience: A conversation system empowered by natural language understanding to accept users' requests and manages dialogs; A multimodal fashion retrieval system empowered by a large-scale pretrained language-image network to retrieve requested apparel; A fashion design system empowered by emerging generative techniques to edit attributes of retrieved clothes.