pytorch_tabular icon indicating copy to clipboard operation
pytorch_tabular copied to clipboard

Published 20 hours ago • verified publisher icon manujosephv

Unable to use DDP

Open Hyphen133 opened this issue 3 years ago • 1 comments

I wasn't able to find propagation of PyTorch Lightning Trainer accelerator this results in ddp_spawn selection

UserWarning: You requested multiple GPUs but did not specify a backend, e.g. Trainer(accelerator="dp"|"ddp"|"ddp2"). Setting accelerator="ddp_spawn" for you.

Hyphen133 avatar Jun 03 '22 21:06 Hyphen133

Only some of the parameters from Trainer were propagated to PyTorch Lightning. I'm changing that in the next release. Latest code in GitHub already allows for this option using trainer_kwargs in TrainerConfig to specify parctically any parameter in the PyTorch Lightning Trainer

manujosephv avatar Jun 07 '22 10:06 manujosephv