hmtbgc

https://scholar.google.com/citations?user=XlsPDvcAAAAJ&hl=zh-CN

Fudan University Shanghai, China 遥遥领先，泰裤辣

Results 1 comments of


                                            hmtbgc

[Question] DeepSpeed Zero3 save_checkpoint() got empty mode_states files

I have met the same problem and my solution is to use deepspeed zero2 instead of zero3