Bayesian-Guided Diversity in Sequential Sampling for Recommender Systems
This addresses the issue of content homogeneity and reduced user engagement in recommender systems, representing an incremental advancement with a novel method for a known bottleneck.
The paper tackled the problem of balancing user relevance and content diversity in recommender systems by proposing a Bayesian-guided sequential sampling framework, resulting in significant diversity improvements without sacrificing relevance in experiments on a real-world dataset.
The challenge of balancing user relevance and content diversity in recommender systems is increasingly critical amid growing concerns about content homogeneity and reduced user engagement. In this work, we propose a novel framework that leverages a multi-objective, contextual sequential sampling strategy. Item selection is guided by Bayesian updates that dynamically adjust scores to optimize diversity. The reward formulation integrates multiple diversity metrics-including the log-determinant volume of a tuned similarity submatrix and ridge leverage scores-along with a diversity gain uncertainty term to address the exploration-exploitation trade-off. Both intra- and inter-batch diversity are modeled to promote serendipity and minimize redundancy. A dominance-based ranking procedure identifies Pareto-optimal item sets, enabling adaptive and balanced selections at each iteration. Experiments on a real-world dataset show that our approach significantly improves diversity without sacrificing relevance, demonstrating its potential to enhance user experience in large-scale recommendation settings.