gpl icon indicating copy to clipboard operation
gpl copied to clipboard

Published 20 hours ago • verified publisher icon UKPLab

Training on multi gpu

Open alsbhn opened this issue 2 years ago • 1 comments

Is there a way to train GPL model with multi gpu? If yes can that help for training with larger batches?

alsbhn avatar Jun 03 '22 07:06 alsbhn

The easiest solution would be to go with nn.DataParallel, although it might not be the most efficient way. Definitely, this will help for training with larger batches. I will have a try and integrate this feature if possible in the near future.

kwang2049 avatar Jun 08 '22 19:06 kwang2049