visdial-bert icon indicating copy to clipboard operation
visdial-bert copied to clipboard

Published 20 hours ago • verified publisher icon vmurahari3

no running on batch_size=80

Open linxi1158 opened this issue 3 years ago • 3 comments

python train.py -batch_size 80 -batch_multiply 1 -lr 2e-5 -image_lr 2e-5 -mask_prob 0.1 -sequences_per_image 2 -start_path checkpoints-release/vqa_pretrained_weights hi, I cannot use batch_size=80 for training. What configuration are you running?

linxi1158 avatar Apr 01 '21 03:04 linxi1158

Are you using 8 gpus?

vmurahari3 avatar Apr 02 '21 02:04 vmurahari3

2gpus

linxi1158 avatar Apr 02 '21 05:04 linxi1158

I train on 8 gpus based on pytorch=1.4, but the result is very poor, must pytorch=1.0?

linxi1158 avatar Apr 03 '21 07:04 linxi1158