DeepSpeed
DeepSpeed copied to clipboard
Fix type checking of offload optimizer before checked class was imported
This bug prevents to run Megatron-LM 10B offload training example
@ollmer Thanks for creating this PR. Can you please share a log of the error that this fixes?
Can one of the admins verify this patch?
@ollmer, is this needed?
Closing this very old PR as it is no longer relevant (Megatron-LM has been deprecated and Megatron-DeepSpeed has a different codebase altogether). Please reopen if needed.