ICT icon indicating copy to clipboard operation
ICT copied to clipboard

cannot run training on FFHQ with batchsize 64 and image size 48

Open LigZhong opened this issue 4 years ago • 3 comments

I have 8 V100 gpus and run the training code without error with image size 32 and batch size 64 but cuda out of memory occurs when I set image size to 48. Anyone met this?

LigZhong avatar Oct 26 '21 11:10 LigZhong

Hi, Are your V100 GPUs 32G?

raywzy avatar Oct 26 '21 11:10 raywzy

Hi, Are your V100 GPUs 32G?

Yes, I used V100 GPUs 32G. I checked that no other process occupied the GPUs.

LigZhong avatar Nov 05 '21 12:11 LigZhong

Have you tried other batch size setting, like 48?

raywzy avatar Nov 07 '21 14:11 raywzy