LGAIDCAug 25, 2023

DAG-ACFL: Asynchronous Clustered Federated Learning based on DAG-DLT

arXiv:2308.13158v13 citationsh-index: 11
Originality Incremental advance
AI Analysis

This addresses efficiency and scalability issues in federated learning for decentralized applications, though it appears incremental by building on existing DAG-DLT and clustered FL approaches.

The paper tackles the problem of non-IID data in federated learning by proposing DAG-ACFL, an asynchronous clustered framework based on DAG-DLT, which improves clustering and training performance while reducing communication and storage costs compared to prior methods.

Federated learning (FL) aims to collaboratively train a global model while ensuring client data privacy. However, FL faces challenges from the non-IID data distribution among clients. Clustered FL (CFL) has emerged as a promising solution, but most existing CFL frameworks adopt synchronous frameworks lacking asynchrony. An asynchronous CFL framework called SDAGFL based on directed acyclic graph distributed ledger techniques (DAG-DLT) was proposed, but its complete decentralization leads to high communication and storage costs. We propose DAG-ACFL, an asynchronous clustered FL framework based on directed acyclic graph distributed ledger techniques (DAG-DLT). We first detail the components of DAG-ACFL. A tip selection algorithm based on the cosine similarity of model parameters is then designed to aggregate models from clients with similar distributions. An adaptive tip selection algorithm leveraging change-point detection dynamically determines the number of selected tips. We evaluate the clustering and training performance of DAG-ACFL on multiple datasets and analyze its communication and storage costs. Experiments show the superiority of DAG-ACFL in asynchronous clustered FL. By combining DAG-DLT with clustered FL, DAG-ACFL realizes robust, decentralized and private model training with efficient performance.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes