Instance_Insertion icon indicating copy to clipboard operation
Instance_Insertion copied to clipboard

Published 20 hours ago • verified publisher icon NVlabs

Multi-GPUs Traning

Open wang-zm18 opened this issue 4 years ago • 2 comments

I have tried to add "torch.nn.DataParallel" to every model, and modifies the batch_size. However, "nvidia-smi" still shows only one gpu is using. I cannot figure out what's wrong. Thank you in advance!

wang-zm18 avatar Sep 22 '20 03:09 wang-zm18

Also, after adding "torch.nn.DataParallel" and changing the batchsize, the code cannot run as we expected. The state is shown in the following pictures. error

wang-zm18 avatar Sep 22 '20 03:09 wang-zm18

@wang-zm18 hi where you able to make this code work ?

abhigoku10 avatar Dec 21 '21 13:12 abhigoku10