LGAIDCJun 18, 2024

Federated Learning with Limited Node Labels

arXiv:2406.12435v1
Originality Incremental advance
AI Analysis

This addresses limitations in federated learning for graph-structured data, offering a more practical solution for distributed applications with scarce labels, though it is incremental in nature.

The paper tackles the problem of missing cross-subgraph edges and high labeled data requirements in subgraph federated learning by proposing FedMpa, a framework that trains an MLP with limited labels and propagates features, achieving effective node classification across six datasets.

Subgraph federated learning (SFL) is a research methodology that has gained significant attention for its potential to handle distributed graph-structured data. In SFL, the local model comprises graph neural networks (GNNs) with a partial graph structure. However, some SFL models have overlooked the significance of missing cross-subgraph edges, which can lead to local GNNs being unable to message-pass global representations to other parties' GNNs. Moreover, existing SFL models require substantial labeled data, which limits their practical applications. To overcome these limitations, we present a novel SFL framework called FedMpa that aims to learn cross-subgraph node representations. FedMpa first trains a multilayer perceptron (MLP) model using a small amount of data and then propagates the federated feature to the local structures. To further improve the embedding representation of nodes with local subgraphs, we introduce the FedMpae method, which reconstructs the local graph structure with an innovation view that applies pooling operation to form super-nodes. Our extensive experiments on six graph datasets demonstrate that FedMpa is highly effective in node classification. Furthermore, our ablation experiments verify the effectiveness of FedMpa.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes