husky23333

Results 1 issues of husky23333

Incomplete save of ckpt files

I am using dlrover on Megatron-DeepSpeed，and my machine has 4 GPUs. The hybrid parallel settings are as follows， TP：[0，1]，[2，3] DP：[0，2]，[1，3] At the same time, I also configured DeepSpeed with Zero...