pytorch-generative
pytorch-generative copied to clipboard
how to use multiple GPUs
Hi Eugen,
I want to use multiple GPUs to train the NADE model at the same time. I'm trying to write device_id=[0,1,2,3] or device_id =(0,1,2,3) in trainer.Trainer( ) ,but error message appears,I don't know how to write it correctly.
@Eureka-Y running on multiple GPUs is a bit involved and requires spawning multiple processes. The easiest way is to run the train.py script directly, or use it as an example to create your own training script.