unsloth Unsloth On Mac

So, I have a macbook, and when i run my model on it, i bascially get an error saying no CUDA device found. I know that there is no gpu on macbooks, so does that mean that I cannot run my model on my mac?(I have a macbook m3 16)

Jun 24 '24 02:06 vermajay111

You definitely can run models using Mac's using programs like Ollama or Jan AI, however if you're talking about fine-tuning with Unsloth, no unfortunately Unsloth will not work on Mac devices however we are working on it.

See here for more info: https://github.com/unslothai/unsloth/issues/4

Jun 26 '24 01:06 shimmyshimmer

@shimmyshimmer what alternatives would you suggest fro Mac users?

Aug 20 '24 09:08 Krythz43

MLX :)

Aug 24 '24 00:08 danielhanchen

Any update since then?

Dec 17 '24 12:12 LaaHudra

+1 Don't let this die

Feb 18 '25 16:02 tridentic

Any timeline for MacBook support ?

Feb 21 '25 22:02 shivswami

Mac book support please :)

Feb 22 '25 02:02 shah-bhaumik

always waiting~

Feb 22 '25 02:02 SfcFromSx

Mac book support please

Feb 22 '25 14:02 magic-YuanTian

Mac book support please

Feb 22 '25 17:02 W2hw

+1 for Apple Silicon (M1/M2/M3) support

Apple’s M chips have become a go-to option for many developers due to their power efficiency and impressive performance. Adding native support for Apple Silicon in Unsloth would be a huge win for the community. It captures a huge chunk of the programmer market and simplifies deploying for a big user base , specifically for ML work .

I want to be actionable , what do we need to do lets crow fund this! . My particular case is I think we should be able to run and train this models locally in our computers and I want to streamline this process on a mac system. Let me know how I can help.