Image-Based Virtual Try-on System With Clothing-Size Adjustment
This addresses the issue for e-commerce users who need accurate virtual try-on experiences, but it is incremental as it builds on existing image-based methods by adding size adjustment.
The paper tackles the problem of generating fitting virtual try-on images that correspond to clothing size by using body and clothing size information as input, resulting in a system that visualizes various clothing sizes in a virtual space with corrections for visual details like collars and overlapping areas.
The conventional image-based virtual try-on method cannot generate fitting images that correspond to the clothing size because the system cannot accurately reflect the body information of a person. In this study, an image-based virtual try-on system that could adjust the clothing size was proposed. The size information of the person and clothing were used as the input for the proposed method to visualize the fitting of various clothing sizes in a virtual space. First, the distance between the shoulder width and height of the clothing in the person image is calculated based on the coordinate information of the key points detected by OpenPose. Then, the system changes the size of only the clothing area of the segmentation map, whose layout is estimated using the size of the person measured in the person image based on the ratio of the person and clothing sizes. If the size of the clothing area increases during the drawing, the details in the collar and overlapping areas are corrected to improve visual appearance.