Running multi GPU inference

[aditya2803]

Hi,

I was using the sample.py file for running inference. While it works fine on a single GPU, I wanted to know how I can run it across multiple GPUs?

[mw66]

try:

https://github.com/karpathy/nanoGPT/issues/289#issuecomment-1726236977