Can be used on CPU?

[SalvatoreRa]

Hi,

amazing works and very curious to try

can be used on a CPU (or parallelized on different CPUs)?

thank you,

Salvatore

[Tugees]

Hi Salvatore. Yes it is possible using the Hugging Face integration. The Readme has been uodated with the details.

[SalvatoreRa]

Thank you, I have just seen and definitely curious to try

[mkardas]

Hi @SalvatoreRa, as of galai version 1.1.0 you should be able to easily run the inference on CPU with load_model(..., num_gpus=0) (the default if there's no CUDA device). Please reopen if you still have any issues.