gpt-fast icon indicating copy to clipboard operation
gpt-fast copied to clipboard

Published 20 hours ago • verified publisher icon pytorch-labs

Apple Silicon support?

Open caseybasichis opened this issue 1 year ago • 3 comments

Any plans to support Apple chips?

caseybasichis avatar Nov 30 '23 18:11 caseybasichis

The code works on M1 with a few simple changes from cuda calls to mps calls but the issue is there is no inductor support for MPS yet so the benefit from torch.compile are not as pronounced

msaroufim avatar Nov 30 '23 20:11 msaroufim

any updates on MPS / Mac Silicone support ?

mikekml avatar May 15 '24 14:05 mikekml

Anything new?

yukiarimo avatar Jun 14 '24 17:06 yukiarimo