mostafamos issues

Repositories
Issues
Comments

Results 1 issues of


                                            mostafamos

Replacing DDP with FSDP since it has sharing capability train.py

I just imported the libs necessary to replace DDP with FSDP, I think that sending the model to GPU isn’t as efficient as sharding, so lets replace DDP, if I...