IRDec 16, 2021

Are Graph Augmentations Necessary? Simple Graph Contrastive Learning for Recommendation

arXiv:2112.08679v4945 citationsHas Code
Originality Incremental advance
AI Analysis

This work addresses the data sparsity issue in recommender systems by simplifying contrastive learning, offering a more efficient approach for practitioners, though it is incremental as it builds on existing CL-based methods.

The paper tackles the problem of understanding the role of graph augmentations in contrastive learning for recommendation systems, finding that they are trivial and proposing a simpler method using uniform noise in embedding space, which improves recommendation accuracy and training efficiency on three benchmark datasets.

Contrastive learning (CL) recently has spurred a fruitful line of research in the field of recommendation, since its ability to extract self-supervised signals from the raw data is well-aligned with recommender systems' needs for tackling the data sparsity issue. A typical pipeline of CL-based recommendation models is first augmenting the user-item bipartite graph with structure perturbations, and then maximizing the node representation consistency between different graph augmentations. Although this paradigm turns out to be effective, what underlies the performance gains is still a mystery. In this paper, we first experimentally disclose that, in CL-based recommendation models, CL operates by learning more evenly distributed user/item representations that can implicitly mitigate the popularity bias. Meanwhile, we reveal that the graph augmentations, which were considered necessary, just play a trivial role. Based on this finding, we propose a simple CL method which discards the graph augmentations and instead adds uniform noises to the embedding space for creating contrastive views. A comprehensive experimental study on three benchmark datasets demonstrates that, though it appears strikingly simple, the proposed method can smoothly adjust the uniformity of learned representations and has distinct advantages over its graph augmentation-based counterparts in terms of recommendation accuracy and training efficiency. The code is released at https://github.com/Coder-Yu/QRec.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes