Mohamad Zamini comments

Repositories
Issues
Comments

Results 3 comments of


                                            Mohamad Zamini

Update vae.py

> ``` > @microsoft-github-policy-service agree > ``` @microsoft-github-policy-service agree

Update trainer_utils.py

> @mzamini92 could you rebase so we can double check no tests are breaking with this and we can merge? Thanks! @muellerzr Thanks for reaching me. I did it based...

[Usage] Deepspeed Zero Stage 3 not able to shard the model

If I use 2 H100 I can run the code but I get OOM. When I increase it to +2 GPUs the model duplicates on GPUs instead of sharding and...