DeepSpeed
DeepSpeed copied to clipboard
CPU-Adam: add compile-flag to enable param-copy from CPU to GPU
This addresses https://github.com/microsoft/DeepSpeed/issues/1279
Can one of the admins verify this patch?
Closing since https://github.com/microsoft/DeepSpeed/pull/2507 should address this.