DenoiseRank: Learning to Rank by Diffusion Models
This work provides a novel generative perspective for the learning to rank problem, which has traditionally been tackled with discriminative models.
DenoiseRank introduces a diffusion-based generative model for learning to rank, achieving competitive performance on benchmark datasets and establishing a new generative approach for the task.
Learning to rank (LTR) is one of the core tasks in Machine Learning. Traditional LTR models have made great progress, but nearly all of them are implemented from discriminative perspective. In this paper, we aim at addressing LTR from a novel perspective, i.e., by a deep generative model. Specifically, we propose a novel denoise rank model, DenoiseRank, which noises the relevant labels in the diffusion process and denoises them on the query documents in the reverse process to accurately predict their distribution. Our model is the first to address traditional LTR from generative perspective and is a diffusion method for LTR. Our extensive experiments on benchmark datasets demonstrated the effectiveness of DenoiseRank, and we believe it provides a benchmark for generative LTR task.