mage icon indicating copy to clipboard operation
mage copied to clipboard

How sensitive is this model to different batch size?

Open yxchng opened this issue 1 year ago • 2 comments

Will small batch size like 512 work? I only have 8 GPUs.

yxchng avatar Jul 26 '23 12:07 yxchng

The smallest batch size I tested is 1024, which gives a similar performance. Since we have a learning rate scaling w.r.t. the batch size, I guess the performance will not degrade much with bsz=512, but I'm not very certain.

LTH14 avatar Jul 26 '23 14:07 LTH14

Will small batch size like 512 work? I only have 8 GPUs.

Hello, could you tell me how to reconstruct an image work with MAGE? I get the output image almost the same as the input image with the released checkpoint? could you help me with that?

cannonli7 avatar Oct 26 '23 11:10 cannonli7