Lei Sang

h-index11
3papers
332citations

3 Papers

7.0IRJul 14
Adaptive Fusion Self-supervised Learning for Recommendation

Yu Zhang, Lei Sang, Yi Zhang et al.

Self-supervised learning (SSL) has recently attracted significant attention in the field of recommender systems. Contrastive learning (CL) stands out as a major SSL paradigm due to its robust ability to generate self-supervised signals. Mainstream graph contrastive learning (GCL)-based methods typically implement CL by creating contrastive views through various data augmentations. Despite these methods are effective, we argue that there still exist several challenges. i) Data augmentation requires additional graph convolution (GCN) or modeling operations, significantly increasing time costs. Moreover, graph augmentation disrupts the intrinsic properties of the user-item graph by randomly removing nodes/edges, while feature augmentation applies noise to all nodes, neglecting their unique characteristics. ii) Existing GCL-based methods use traditional CL objectives to capture self-supervised signals. However, few studies have explored obtaining more beneficial CL objectives from more perspectives and have attempted to fuse the varying self-supervised signals from these CL objectives to enhance recommendation performance. To overcome these challenges, we propose Adaptive Fusion Graph Contrastive Learning (AFGCL) for recommendation. AFGCL exploits structural information naturally produced during graph propagation to construct contrastive representations. Specifically, we introduce an adaptive fusion strategy that estimates the contributions of different propagation depths to the primary recommendation task and adaptively combines their representations. Furthermore, we construct an explicit representation for each observed user--item interaction and propose a fused contrastive objective. Experimental results on three public datasets demonstrate the superior recommendation performance and training efficiency of AFGCL compared with state-of-the-art baselines.

6.6IRMar 22Code
TF4CTR: Twin Focus Framework for CTR Prediction via Adaptive Sample Differentiation

Honghao Li, Qiuze Ru, Yiwen Zhang et al.

Effective feature interaction modeling is critical for enhancing the accuracy of click-through rate (CTR) prediction in industrial recommender systems. Most of the current deep CTR models resort to building complex network architectures to better capture intricate feature interactions or user behaviors. However, we identify two limitations in these models: (1) the samples given to the model are undifferentiated, which may lead the model to learn a larger number of easy samples in a single-minded manner while ignoring a smaller number of hard samples, thus reducing the model's generalization ability; (2) differentiated feature interaction encoders are designed to capture different interactions information but receive consistent supervision signals, thereby limiting the effectiveness of the encoder. To bridge the identified gaps, this paper introduces a novel CTR prediction framework by integrating the plug-and-play Twin Focus (TF) Loss, Sample Selection Embedding Module (SSEM), and Dynamic Fusion Module (DFM), named the Twin Focus Framework for CTR (TF4CTR). Specifically, the framework employs the SSEM at the bottom of the model to differentiate between samples, thereby assigning a more suitable encoder for each sample. Meanwhile, the TF Loss provides tailored supervision signals to both simple and complex encoders. Moreover, the DFM dynamically fuses the feature interaction information captured by the encoders, resulting in more accurate predictions. Experiments on five real-world datasets confirm the effectiveness and compatibility of the framework, demonstrating its capacity to enhance various representative baselines in a model-agnostic manner. To facilitate reproducible research, our open-sourced code and detailed running logs will be made available at: https://github.com/salmon1802/TF4CTR.

9.6AIMar 6, 2024
A Privacy-Preserving Framework with Multi-Modal Data for Cross-Domain Recommendation

Li Wang, Lei Sang, Quangui Zhang et al.

Cross-domain recommendation (CDR) aims to enhance recommendation accuracy in a target domain with sparse data by leveraging rich information in a source domain, thereby addressing the data-sparsity problem. Some existing CDR methods highlight the advantages of extracting domain-common and domain-specific features to learn comprehensive user and item representations. However, these methods can't effectively disentangle these components as they often rely on simple user-item historical interaction information (such as ratings, clicks, and browsing), neglecting the rich multi-modal features. Additionally, they don't protect user-sensitive data from potential leakage during knowledge transfer between domains. To address these challenges, we propose a Privacy-Preserving Framework with Multi-Modal Data for Cross-Domain Recommendation, called P2M2-CDR. Specifically, we first design a multi-modal disentangled encoder that utilizes multi-modal information to disentangle more informative domain-common and domain-specific embeddings. Furthermore, we introduce a privacy-preserving decoder to mitigate user privacy leakage during knowledge transfer. Local differential privacy (LDP) is utilized to obfuscate the disentangled embeddings before inter-domain exchange, thereby enhancing privacy protection. To ensure both consistency and differentiation among these obfuscated disentangled embeddings, we incorporate contrastive learning-based domain-inter and domain-intra losses. Extensive Experiments conducted on four real-world datasets demonstrate that P2M2-CDR outperforms other state-of-the-art single-domain and cross-domain baselines.