Towards Explainable Personalized Recommendations by Learning from Users' Photos
This addresses the need for explainable recommendations for users and companies, though it is incremental by applying existing methods to a new data type (photos).
The paper tackles the problem of explainable personalized recommendations by predicting which photo a user would take of an item, using this as an explanation to increase reliability; it demonstrates this with data from TripAdvisor reviews and photos of restaurants in six cities.
Explaining the output of a complex system, such as a Recommender System (RS), is becoming of utmost importance for both users and companies. In this paper we explore the idea that personalized explanations can be learned as recommendation themselves. There are plenty of online services where users can upload some photos, in addition to rating items. We assume that users take these photos to reinforce or justify their opinions about the items. For this reason we try to predict what photo a user would take of an item, because that image is the argument that can best convince her of the qualities of the item. In this sense, an RS can explain its results and, therefore, increase its reliability. Furthermore, once we have a model to predict attractive images for users, we can estimate their distribution. Thus, the companies acquire a vivid knowledge about the aspects that the clients highlight of their products. The paper includes a formal framework that estimates the authorship probability for a given pair (user, photo). To illustrate the proposal, we use data gathered from TripAdvisor containing the reviews (with photos) of restaurants in six cities of different sizes.