Controlling Perceptual Factors in Neural Style Transfer
This work addresses the problem of limited control and common artifacts in neural style transfer for image manipulation applications, representing an incremental improvement.
The authors extended neural style transfer to control spatial location, color, and scale, enabling high-resolution stylization and reducing failures like applying ground textures to sky regions, while also allowing style combination from multiple sources for new styles and efficient large-scale stylization.
Neural Style Transfer has shown very exciting results enabling new forms of image manipulation. Here we extend the existing method to introduce control over spatial location, colour information and across spatial scale. We demonstrate how this enhances the method by allowing high-resolution controlled stylisation and helps to alleviate common failure cases such as applying ground textures to sky regions. Furthermore, by decomposing style into these perceptual factors we enable the combination of style information from multiple sources to generate new, perceptually appealing styles from existing ones. We also describe how these methods can be used to more efficiently produce large size, high-quality stylisation. Finally we show how the introduced control measures can be applied in recent methods for Fast Neural Style Transfer.