Rangehow comments

Results 73 comments of


                                            Rangehow

AssertionError: no sync context manager is incompatible with gradientpartitioning logic of ZeRo stage 3

+1, met this on deepspeed 0.16.1 with hf trainer

save_state() fails when using DeepSpeed with multiple models where some models are frozen some are being trained

same question met in the same scripts, we need to reopen this issue I guess

save_state() fails when using DeepSpeed with multiple models where some models are frozen some are being trained

> Thanks, definitely will try and take a look at it! The issue still exists, and the code that reproduces the problem is even the official example (it doesn't save,...