ai-toolkit icon indicating copy to clipboard operation
ai-toolkit copied to clipboard

MPS Support on Apple Silicon devices

Open ivanfioravanti opened this issue 3 weeks ago • 5 comments

MPS Support on Apple Silicon devices. This should solve #127 Many changes had to be applied to make this work properly.

ivanfioravanti avatar Nov 30 '25 17:11 ivanfioravanti

@jaretburkett you are the boss here, up to you if you want to integrate MPS support or not. For sure from PyTorch 2.9 things has improved a lot.

ivanfioravanti avatar Nov 30 '25 17:11 ivanfioravanti

I looked over the changes, I don't see anything that looks like it would cause an issue. I'll run some tests on it to make sure. @ivanfioravanti, how much ram on mac was needed to train z-image-turbo? I have a 24GB macbook I can test on.

jaretburkett avatar Nov 30 '25 18:11 jaretburkett

Let me try today. Keep you posted.

ivanfioravanti avatar Dec 02 '25 01:12 ivanfioravanti

~30GB I can grant you access to an M3 Ultra 512GB, but next week.

ivanfioravanti avatar Dec 02 '25 02:12 ivanfioravanti

Excellent. What settings are you using? I had to disable transformations to get going using PyTorch 2.7.0.

FritzTheCatfish avatar Dec 04 '25 15:12 FritzTheCatfish