BigGAN-PyTorch icon indicating copy to clipboard operation
BigGAN-PyTorch copied to clipboard

Looking forward to offical TPU-version BigGAN code~

Open AaronAnima opened this issue 5 years ago • 1 comments

Hi ajbrock, Thanks for open-source BigGAN code, which benefits a lot on other explore of BigGAN. But considering the cost of time, we hope to train biggan on TPU, so we use a version of tensorflow code that looks close to yours(https://github.com/Octavian-ai/BigGAN-TPU-TensorFlow). But many of the attempts turned out to be bad. Can you continue to release the official biggan code of TPU version?

Sincerely

config: Imagenet2012 tf-1.12.2 GCP v3-8 pod training for up to 300k steps

Some failed results: 100k: 100k samples 180k: 180k samples 300k: 300k samples

AaronAnima avatar Oct 21 '19 07:10 AaronAnima

Hi, I implemented three TPU enabled PyTorch training repos for BigGAN-PyTorch, all of which are based on this repo.

BigGAN-PyTorch-TPU-Single: Training BigGAN with a single TPU. BigGAN-PyTorch-TPU-Parallel: Parallel version (multiple-thread) for training BigGAN with TPU. BigGAN-PyTorch-TPU-Distribute: Distributed version (multiple-process) for training BigGAN with TPU.

You might want to have a try. Pull requests to fix some of the issues would be appreciated.

shizhediao avatar May 02 '20 03:05 shizhediao