qiaojiim comments

Repositories
Issues
Comments

Results 1 comments of


                                            qiaojiim

Deepspeed model engine can not load a saved checkpoint. "RuntimeError: The size of tensor a x must match the size of tensor b y at non-singleton dimension z"

I trained and `save_checkpoint` using 4 GPUs, but when I tried to `load_checkpoint` using 1 GPU, I encountered the same issue. I suspect that ZeRO3 splits the model and saves...