PiPPy icon indicating copy to clipboard operation
PiPPy copied to clipboard

How to run the gpt2 example on a single node with four GPU?

Open lsder opened this issue 2 years ago • 0 comments

I am trying to reproduce the gpt2 example in a single node without slurm for some performance metrics, but the code only provides slurm scripts. How should I modify the code to implement this example in a single node?

lsder avatar May 16 '23 11:05 lsder