mmfewshot icon indicating copy to clipboard operation
mmfewshot copied to clipboard

I only have one GPU, Do I need to change lr = 0.001 to 0.000125?

Open kike-0304 opened this issue 3 years ago • 2 comments

I only have one GPU, Do I need to change lr = 0.001 to 0.000125? Do samples_ per_ gpu = 2 need to be change?

kike-0304 avatar Apr 23 '22 12:04 kike-0304

batch size = samples_per_gpu * GPUs, and the default GPUs we used is 8. If you want to use one GPU, it is common to let lr = default_lr / 8. If you want to change the samples_per_gpu, you also need to change the lr

BIGWangYuDong avatar May 04 '22 03:05 BIGWangYuDong

I have changed lr from 0.001 to 0.000125 if I only have one GPU. Should I change the max_iters from 18000 to 8*18000 to make the total epoch equal?

YanxingLiu avatar Jul 03 '22 02:07 YanxingLiu