FedML icon indicating copy to clipboard operation
FedML copied to clipboard

Published 20 hours ago • verified publisher icon FedML-AI

Asynchronous Federated Learning

Open xuannn1998 opened this issue 2 years ago • 4 comments

Hi there,

Are there any implementations related to asynchronous FL? Especially the state-of-the-art paper: Asynchronous Federated Optimization

xuannn1998 avatar Jul 05 '22 16:07 xuannn1998

@xuannn1998 good questions. We will release our LightSecAgg (MLSys 2022) soon.

https://proceedings.mlsys.org/paper/2022/file/d2ddea18f00665ce8623e36bd4e3c7c5-Paper.pdf

FedML-AI-admin avatar Jul 06 '22 05:07 FedML-AI-admin

Current FedAvg algorithm is done by sequential training (simulation with a single process). In order to achieve asynchronous FL, is it possible to change training phase to parallel?

xuannn1998 avatar Jul 08 '22 10:07 xuannn1998

@xuannn1998 Please check this example, we do support simulation with sequential distributed training: python/examples/simulation/mpi_torch_fedavg_seq/README.md

as for asynchronous FL, it's better to run it in real-world system. Do you hope to support async FL in simulation or real-world cross-silo?

chaoyanghe avatar Aug 19 '22 16:08 chaoyanghe

@xuannn1998 We will revisit this soon.

fedml-dimitris avatar Oct 25 '23 01:10 fedml-dimitris