gpt-2-Pytorch icon indicating copy to clipboard operation
gpt-2-Pytorch copied to clipboard

Published 20 hours ago • verified publisher icon graykode

How to train/fine tune the model with multiple GPUs?

Open gudiandian opened this issue 3 years ago • 0 comments

I have pulled the code from branch train. Is there a way to train or fine tune the GPT-2 model with data parallelism on multiple GPUs? Thanks for your help.

gudiandian avatar Aug 30 '20 03:08 gudiandian