CVJun 26, 2022

Automatic Generation of Product-Image Sequence in E-commerce

arXiv:2206.12994v17 citationsh-index: 44
Originality Incremental advance
AI Analysis

This addresses the labor-intensive and costly process of manually curating product images for large e-commerce platforms like JD.com, though it appears incremental as it builds on existing methods for image classification and selection.

The paper tackles the problem of automatically generating and selecting product-image sequences for e-commerce platforms to reduce manual effort and ensure compliance with image rules, achieving a 13.6% reject rate for about 1.5 million products by December 2021.

Product images are essential for providing desirable user experience in an e-commerce platform. For a platform with billions of products, it is extremely time-costly and labor-expensive to manually pick and organize qualified images. Furthermore, there are the numerous and complicated image rules that a product image needs to comply in order to be generated/selected. To address these challenges, in this paper, we present a new learning framework in order to achieve Automatic Generation of Product-Image Sequence (AGPIS) in e-commerce. To this end, we propose a Multi-modality Unified Image-sequence Classifier (MUIsC), which is able to simultaneously detect all categories of rule violations through learning. MUIsC leverages textual review feedback as the additional training target and utilizes product textual description to provide extra semantic information. Based on offline evaluations, we show that the proposed MUIsC significantly outperforms various baselines. Besides MUIsC, we also integrate some other important modules in the proposed framework, such as primary image selection, noncompliant content detection, and image deduplication. With all these modules, our framework works effectively and efficiently in JD.com recommendation platform. By Dec 2021, our AGPIS framework has generated high-standard images for about 1.5 million products and achieves 13.6% in reject rate.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes