DeepSpeed icon indicating copy to clipboard operation
DeepSpeed copied to clipboard

Adagrad support in ZeRO

Open jomayeri opened this issue 2 years ago • 0 comments

Adding the Pytorch Adagrad optimizer to the list of supported ZeRO optimizers.

jomayeri avatar Apr 27 '23 23:04 jomayeri