CVIRDec 11, 2020

Garment Recommendation with Memory Augmented Neural Networks

arXiv:2012.06200v126 citations
AI Analysis

This work addresses the problem of personalized garment recommendation for individuals seeking appropriate clothing combinations, offering an incremental improvement in recommendation accuracy.

This paper proposes a garment recommendation system for pairing tops and bottoms using a Memory Augmented Neural Network (MANN). The system stores a non-redundant subset of samples to retrieve suitable bottoms for a given top, and further refines recommendations by incorporating user preferences via Matrix Factorization, achieving state-of-the-art results on the IQON3000 dataset.

Fashion plays a pivotal role in society. Combining garments appropriately is essential for people to communicate their personality and style. Also different events require outfits to be thoroughly chosen to comply with underlying social clothing rules. Therefore, combining garments appropriately might not be trivial. The fashion industry has turned this into a massive source of income, relying on complex recommendation systems to retrieve and suggest appropriate clothing items for customers. To perform better recommendations, personalized suggestions can be performed, taking into account user preferences or purchase histories. In this paper, we propose a garment recommendation system to pair different clothing items, namely tops and bottoms, exploiting a Memory Augmented Neural Network (MANN). By training a memory writing controller, we are able to store a non-redundant subset of samples, which is then used to retrieve a ranked list of suitable bottoms to complement a given top. In particular, we aim at retrieving a variety of modalities in which a certain garment can be combined. To refine our recommendations, we then include user preferences via Matrix Factorization. We experiment on IQON3000, a dataset collected from an online fashion community, reporting state of the art results.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes