PatrickStar
PatrickStar copied to clipboard
PatrickStar's Performance in Models Like GANs
Hi! I am a newbie in this field. DeepSpeed provides a tutorial on GAN (https://www.deepspeed.ai/tutorials/gan/). I am curious about PatrickStar's performance in models like GANs or other CV models. I really hope that PatrickStar can make my poor GPU accommodate a large-scale GAN.
Thank you for your interest in our project!
So far we are focusing on NLP pretrain models and haven't test on CV models yet. PatrickStar should work on CV models if you are using adam optimizer. Feel free to give it a try and report the bugs if there are any :)
Thank you for your interest in our project!
So far we are focusing on NLP pretrain models and haven't test on CV models yet. PatrickStar should work on CV models if you are using adam optimizer. Feel free to give it a try and report the bugs if there are any :)
thanks for help !