mmfewshot
mmfewshot copied to clipboard
I only have one GPU, Do I need to change lr = 0.001 to 0.000125?
I only have one GPU, Do I need to change lr = 0.001 to 0.000125? Do samples_ per_ gpu = 2 need to be change?
batch size = samples_per_gpu * GPUs, and the default GPUs we used is 8. If you want to use one GPU, it is common to let lr = default_lr / 8. If you want to change the samples_per_gpu, you also need to change the lr
I have changed lr from 0.001 to 0.000125 if I only have one GPU. Should I change the max_iters from 18000 to 8*18000 to make the total epoch equal?