decaNLP icon indicating copy to clipboard operation
decaNLP copied to clipboard

Multi GPU

Open Timopheym opened this issue 6 years ago • 1 comments

Sorry when is it planned to have multi-GPU? On my 1080 it takes apprx. 20min per epoch and it's almost impossible to train it for real use in current tasks =( I have two more GPU's that might help.. may be I can somehow help to enforce the implementation?

Timopheym avatar Aug 03 '18 15:08 Timopheym

Multi-GPU support broke when I added the task-specific validation metrics for each task. So we'll have to find a way to get around the problems that creep up or we'll have to turn off some metrics on multi-gpu runs.

bmccann avatar Aug 09 '18 00:08 bmccann