shangao

Results 3 comments of shangao

I have met the same problem. If you train with deepspeed, save the model and run python zero_to_fp32.py, you will get the pytorch_model.bin. The pytorch_model.bin is the full model weight...