Deciphering Compatibility Relationships with Textual Descriptions via Extraction and Explanation
This work addresses the challenge of improving explanation quality in AI-driven fashion recommendations, which is incremental as it builds on existing models with a new dataset and method.
The paper tackles the problem of generating informative explanations for fashion item compatibility in outfit recommendations by introducing the Pair Fashion Explanation dataset and a two-stage pipeline model, which produces knowledgeable and understandable descriptions as validated by automatic metrics and human evaluation.
Understanding and accurately explaining compatibility relationships between fashion items is a challenging problem in the burgeoning domain of AI-driven outfit recommendations. Present models, while making strides in this area, still occasionally fall short, offering explanations that can be elementary and repetitive. This work aims to address these shortcomings by introducing the Pair Fashion Explanation (PFE) dataset, a unique resource that has been curated to illuminate these compatibility relationships. Furthermore, we propose an innovative two-stage pipeline model that leverages this dataset. This fine-tuning allows the model to generate explanations that convey the compatibility relationships between items. Our experiments showcase the model's potential in crafting descriptions that are knowledgeable, aligned with ground-truth matching correlations, and that produce understandable and informative descriptions, as assessed by both automatic metrics and human evaluation. Our code and data are released at https://github.com/wangyu-ustc/PairFashionExplanation