Regional Style and Color Transfer
This addresses the issue of unnatural style transfer for images with foreground elements, such as person figures, but is incremental as it builds on existing style transfer methods by adding segmentation and color adjustment.
The paper tackles the problem of style transfer causing stylistic inconsistencies or foreground object distortion in images with foreground elements, by proposing a method that isolates foreground objects, applies style transfer only to the background, and reintegrates them with color transfer and feathering, resulting in significantly more natural stylistic transformations.
This paper presents a novel contribution to the field of regional style transfer. Existing methods often suffer from the drawback of applying style homogeneously across the entire image, leading to stylistic inconsistencies or foreground object twisted when applied to image with foreground elements such as person figures. To address this limitation, we propose a new approach that leverages a segmentation network to precisely isolate foreground objects within the input image. Subsequently, style transfer is applied exclusively to the background region. The isolated foreground objects are then carefully reintegrated into the style-transferred background. To enhance the visual coherence between foreground and background, a color transfer step is employed on the foreground elements prior to their rein-corporation. Finally, we utilize feathering techniques to achieve a seamless amalgamation of foreground and background, resulting in a visually unified and aesthetically pleasing final composition. Extensive evaluations demonstrate that our proposed approach yields significantly more natural stylistic transformations compared to conventional methods.