SPLGJun 13, 2024

Federated Contrastive Learning for Personalized Semantic Communication

arXiv:2406.09182v116 citations
Originality Incremental advance
AI Analysis

This work addresses the challenge of semantic imbalance in distributed clients for personalized communication, offering an incremental improvement over existing distributed learning methods.

The paper tackles the problem of personalized semantic communication in federated settings by proposing a federated contrastive learning framework that trains local semantic encoders and a global decoder without client-side model aggregation, achieving superior task performance and robustness in simulations, especially under low signal-to-noise ratios and high data heterogeneity.

In this letter, we design a federated contrastive learning (FedCL) framework aimed at supporting personalized semantic communication. Our FedCL enables collaborative training of local semantic encoders across multiple clients and a global semantic decoder owned by the base station. This framework supports heterogeneous semantic encoders since it does not require client-side model aggregation. Furthermore, to tackle the semantic imbalance issue arising from heterogeneous datasets across distributed clients, we employ contrastive learning to train a semantic centroid generator (SCG). This generator obtains representative global semantic centroids that exhibit intra-semantic compactness and inter-semantic separability. Consequently, it provides superior supervision for learning discriminative local semantic features. Additionally, we conduct theoretical analysis to quantify the convergence performance of FedCL. Simulation results verify the superiority of the proposed FedCL framework compared to other distributed learning benchmarks in terms of task performance and robustness under different numbers of clients and channel conditions, especially in low signal-to-noise ratio and highly heterogeneous data scenarios.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes