PiPPy
PiPPy copied to clipboard
How to run the gpt2 example on a single node with four GPU?
I am trying to reproduce the gpt2 example in a single node without slurm for some performance metrics, but the code only provides slurm scripts. How should I modify the code to implement this example in a single node?