Samrat Thapa comments

Repositories
Issues
Comments

Results 1 comments of


                                            Samrat Thapa

I can't train model using 2 GPUs

The following code works for me on 4 GPUs ``` CUDA_VISIBLE_DEVICES=0,1,2,3 python -m torch.distributed.launch --nproc_per_node=4 run_captioning.py \ --model_name_or_path ./checkpoints/checkpoint-29-66420 \ --do_train \ --do_lower_case \ --evaluate_during_training \ --add_od_labels \ --learning_rate 0.00003...