exo icon indicating copy to clipboard operation
exo copied to clipboard

Multi-GPU on same device

Open AlexCheema opened this issue 1 year ago • 1 comments

Not a problem on Macs since they only have 1 GPU. On other machines, we default to tinygrad. Right now we pick the DEFAULT device.

The desired behaviour needs to be scoped out here. The simplest would be require the user (we can also provide a helper script) to run multiple instances of exo on the same device. We'd need to change how discovery works to support multiple instances of exo on the same device.

AlexCheema avatar Aug 05 '24 16:08 AlexCheema

When #173 is merged one can simply run a docker container per GPU.

rallisf1 avatar Sep 12 '24 00:09 rallisf1