learn2learn icon indicating copy to clipboard operation
learn2learn copied to clipboard

Meta-learning rate in reptile example is not decaying (as of now).

Open mi92 opened this issue 2 years ago • 0 comments

Added meta_lr_final parameter to indicate the final value of the meta learning rate. By setting meta_lr_final to a smaller value than meta_lr, the meta learning rate is effectively decayed during training. Before it was constant due to the bug of using meta_lr both times in the weighted sum.

Description

Fixes #[ISSUE NUMBER]

Replace this line by a one sentence summary of your PR.

If necessary, use the following space to provide context or more details.

Contribution Checklist

If your contribution modifies code in the core library (not docs, tests, or examples), please fill the following checklist.

  • [ ] My contribution is listed in CHANGELOG.md with attribution.
  • [x] My contribution modifies code in the main library.
  • [ ] My modifications are tested.
  • [ ] My modifications are documented.

Optional

If you make major changes to the core library, please run make alltests and copy-paste the content of alltests.txt below.

[PASTE HERE]

mi92 avatar Aug 12 '22 05:08 mi92