FashionNet: Personalized Outfit Recommendation with Deep Neural Network
This addresses the need for intelligent fashion recommendation in online shopping and social networks, offering a novel approach to set-based recommendations, though it is incremental in adapting existing deep learning techniques to this domain.
The paper tackles the problem of personalized outfit recommendation by proposing FashionNet, a deep neural network system that suggests sets of compatible clothing items based on user preferences, achieving validated effectiveness on a large dataset from a fashion social network.
With the rapid growth of fashion-focused social networks and online shopping, intelligent fashion recommendation is now in great need. We design algorithms which automatically suggest users outfits (e.g. a shirt, together with a skirt and a pair of high-heel shoes), that fit their personal fashion preferences. Recommending sets, each of which is composed of multiple interacted items, is relatively new to recommender systems, which usually recommend individual items to users. We explore the use of deep networks for this challenging task. Our system, dubbed FashionNet, consists of two components, a feature network for feature extraction and a matching network for compatibility computation. The former is achieved through a deep convolutional network. And for the latter, we adopt a multi-layer fully-connected network structure. We design and compare three alternative architectures for FashionNet. To achieve personalized recommendation, we develop a two-stage training strategy, which uses the fine-tuning technique to transfer a general compatibility model to a model that embeds personal preference. Experiments on a large scale data set collected from a popular fashion-focused social network validate the effectiveness of the proposed networks.