flower icon indicating copy to clipboard operation
flower copied to clipboard

FedAvgM strategy: Add Nesterov Accelerated Gradient (NAG)

Open gubertoli opened this issue 2 years ago • 0 comments

Issue

Description

This PR improves the FedAvgM implementation FedAvgM introducing the Nesterov Accelerated Gradient (NAG), the same as reported in the original FedAvgM paper:

https://arxiv.org/pdf/1909.06335.pdf

Related issues/PRs

N/A

Proposal

Introduce the calculation of NAG as part of the global model parameters update.

Explanation

The improvement of the introduction of NAG is reported on the FedAvgM baseline:

https://github.com/adap/flower/tree/main/baselines/fedavgm#comparison-between-the-custom-fedavgm-and-fedavgm

Checklist

  • [ ] Implement proposed change
  • [ ] Write tests
  • [ ] Update documentation
  • [ ] Update the changelog entry below
  • [ ] Make CI checks pass
  • [ ] Ping maintainers on Slack (channel #contributions)

Changelog entry

Any other comments?

PR aligned with @jafermarq

gubertoli avatar Dec 30 '23 01:12 gubertoli