xinruozhang575

Results 1 comments of xinruozhang575

我也遇到了同样的问题,在deepspeed issues中有找到相关说明https://github.com/microsoft/DeepSpeed/issues/3234,ZeRO stage 3支持zero.init,stage 1和2不支持,我把deepspeed.json中stage改成3解决了这个问题