pytorch-generative icon indicating copy to clipboard operation
pytorch-generative copied to clipboard

how to use multiple GPUs

Open Eureka-Y opened this issue 2 years ago • 1 comments

Hi Eugen, I want to use multiple GPUs to train the NADE model at the same time. I'm trying to write device_id=[0,1,2,3] or device_id =(0,1,2,3) in trainer.Trainer( ) ,but error message appears,I don't know how to write it correctly.

Eureka-Y avatar Apr 02 '23 10:04 Eureka-Y

@Eureka-Y running on multiple GPUs is a bit involved and requires spawning multiple processes. The easiest way is to run the train.py script directly, or use it as an example to create your own training script.

EugenHotaj avatar Apr 10 '23 13:04 EugenHotaj