exo
exo copied to clipboard
Support all MLX backends
MLX supports many computational backends - cpu, cuda, metal and gpu. It should be easy to specify this information as a parallel part of the InstanceMeta, and pass it into mx.set_default_device() or mx.set_default_stream() early in the runners lifecycle. This could unlock basic support for Nvidia GPUs and Linux CPUs without introducing a new runner.