DeepSpeed
DeepSpeed copied to clipboard
[BUG] Parameter name of `DeepSpeedCPUAdam` optimizer
Describe the bug
The name of the first parameter of DeepSpeedCPUAdam is different from that of other optimizers. It's model_params. But in the other optimizers, they are all params.
When I pass parameters with keywords, it causes trouble. I have to change the key to use DeepSpeedCPUAdam.
Expected behavior
Replace model_params with params.
@mypydl - this also looks to be set for cpu_adagrad and cpu_lion.